Experiment request: frameshift

[hgarrereyn]

Hi, I'm interested in evaluating a fork of LibAFL and AFL++ (frameshift variant).

Would you be able to run the following experiment:

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-05-20-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

@DonggeLiu would you be able to help here :)

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-05-22-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

I'm still only seeing an input folder here: https://storage.googleapis.com/fuzzbench-data/index.html?prefix=2025-05-22-frameshift/

Does it normally take this long to start up?

[hgarrereyn]

@DonggeLiu it looks like this failed due to insufficient resources in us-central1-c. I've switched it to use us-central1-a, would you be able to rerun?

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-05-23-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

@DonggeLiu thanks! Seems like its not running though--do I need to edit anything else for a rerun?

[DonggeLiu]

@DonggeLiu thanks! Seems like its not running though--do I need to edit anything else for a rerun?

No, I will rerun it.
It's weird that the parser was triggered but thought no exp was requested.
Sorry that FB was not stable recently.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-05-23-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-05-26-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

Is there an available report for this?

[DonggeLiu]

The experiment failed due to duplicated experiment name.
Let me re-run.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-06-02-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

Hi @DonggeLiu thanks for helping with this, it seems like this experiment didn't start however. I'm not seeing a folder in https://storage.googleapis.com/fuzzbench-data/index.html

[DonggeLiu]

This very strange, the CI experiment keeps failing for different reasons.
Let me start another one.

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-06-04-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

Hmm unfortunately still not seeing an experiment folder

[jonathanmetzman]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-06-04-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift

[hgarrereyn]

Thanks @jonathanmetzman! Feel free to run with the systemd and php benchmarks disabled, I'm not sure why those are failing but I'm seeing that locally too.

[jonathanmetzman]

The experiment infra seems to be broken right now and this experiment didn't seem to work

[DonggeLiu]

/gcbrun run_experiment.py -a --experiment-config /opt/fuzzbench/service/experiment-config.yaml --experiment-name 2025-06-11-frameshift --fuzzers aflplusplus_frameshift libafl_frameshift