New release

[waghanza]

This PR creates a new release.

The main goal is to hide framework that does not correctly implement expected endpoints

[waghanza]

@itsumura-h @bung87 I've disabled basolato and scorper since failing for a long time

[waghanza]

@dominikzogg Could you take a look at chubby with swoole ? not sure why it does not listen to 0.0.0.0:3000

[waghanza]

@bajb Could you take a look at https://github.com/the-benchmarker/web-frameworks/actions/runs/19014117454/job/54299451161?pr=8814 ?

[waghanza]

@sy-records Could you take a look at https://github.com/the-benchmarker/web-frameworks/actions/runs/19014117454/job/54299451200#step:9:56 and https://github.com/the-benchmarker/web-frameworks/actions/runs/19014117454/job/54299451205#step:9:103 ?

[waghanza]

@natanfelles Could you check https://github.com/the-benchmarker/web-frameworks/actions/runs/19014117454/job/54299451132#step:9:47 please ?

[waghanza]

@rajkumardusad could you take a look at unic, seems not working with swoole 6

[waghanza]

@JohnCoene with ambiorix I have

R version 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

  Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> source("app.R")
Error in library(ambiorix) : there is no package called ‘ambiorix’
Calls: source -> withVisible -> eval -> eval -> library
Execution halted

with last version of r.

Could you take a look ?

[dominikzogg]

@waghanza when i use excactly the same code + composer.json in a rockylinux version 10 based docker container with swoole version 6.1.1 on php version 8.4.14, i can do manual requests, without an issue.

[waghanza]

I have no issue ussing php locally @dominikzogg

waghanza@Host-003:~/web-frameworks$ curl http://127.0.0.1:3000 -v
*   Trying 127.0.0.1:3000...
* Connected to 127.0.0.1 (127.0.0.1) port 3000
* using HTTP/1.x
> GET / HTTP/1.1
> Host: 127.0.0.1:3000
> User-Agent: curl/8.11.1
> Accept: */*
>
* Request completely sent off
< HTTP/1.1 200 OK
< Server: swoole-http-server
< Date: Sun, 02 Nov 2025 19:11:59 GMT
< Connection: keep-alive
< Content-Type: text/html
< Content-Length: 0
<
* Connection #0 to host 127.0.0.1 left intact

but trouble using docker

could you print me info about your docker (version ..) ?

[rajkumardusad]

@rajkumardusad could you take a look at unic, seems not working with swoole 6

@waghanza the unic framework is outdated and no longer maintained, please remove it from the benchmark.

[dominikzogg]

@waghanza i use Docker version 28.5.1, build 2.fc43 on my Fedora 43 and i used my php docker setup: https://github.com/chubbyphp/docker

[dominikzogg]

@waghanza when i try to test if the way intended in this repository i failed to get anything running. Besides the readme i had todo all this on Fedora host:

sudo dnf search \
    cargo \
    findbin \
    perl \
    perl-File-Compare \
    perl-Module-CoreList \
    ruby-devel \
    rubygem-rake

cargo install oha

But when i try to test lumen as mentioned in the readme (before trying to debug my stuff) i get

export FRAMEWORK=php/lumen; make -f $FRAMEWORK/.Makefile collect
/home/schreiner/.cargo/bin/oha --wait-ongoing-requests-after-deadline --no-tui --disable-keepalive --latency-correction -c 64 -z 15s -m GET --output-format json --output /home/schreiner/Projects/dominikzogg/web-frameworks/php/lumen/.results/64/_.json http:/`cat /home/schreiner/Projects/dominikzogg/web-frameworks/php/lumen/ip-php-fpm.txt`:3000
cat: /home/schreiner/Projects/dominikzogg/web-frameworks/php/lumen/ip-php-fpm.txt: Datei oder Verzeichnis nicht gefunden
Error: empty host
make: *** [php/lumen/.Makefile:6: collect] Fehler 1

[waghanza]

Indeed the README is not upto date.

I'll update it.

This message is from oha, you have no directory to output its json file

[dominikzogg]

@waghanza any idea howto fix that, i already cloned the repo twice and followed the steup + did what i wrote.

[JohnCoene]

@JohnCoene with ambiorix I have

R version 4.5.2 (2025-10-31) -- "[Not] Part in a Rumble"
Copyright (C) 2025 The R Foundation for Statistical Computing
Platform: x86_64-pc-linux-gnu

R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.

  Natural language support but running in an English locale

R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.

Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.

> source("app.R")
Error in library(ambiorix) : there is no package called ‘ambiorix’
Calls: source -> withVisible -> eval -> eval -> library
Execution halted

with last version of r.

Could you take a look ?

Change https://github.com/the-benchmarker/web-frameworks/blob/master/r/ambiorix/DESCRIPTION

to

Remotes: 
  ambiorix-web/ambiorix

[waghanza]

@waghanza any idea howto fix that, i already cloned the repo twice and followed the steup + did what i wrote.

You can comment all lines in run.sh that start with find, except the line with -mindepth is 1 (or maxdepth I do not remember)

And run

bash run.sh php/chubbyphp-swoole

[waghanza]

@dominikzogg chubbyts-uwebsockets is node compatible with node 25

[waghanza]

chubbyts-uwebsockets / aplus-app / chubbyphp-swoole / mezzio / slim-swoole / ambiorix / grape are hidden as for now