Build, cleanups and TextArchive#15

Open

lfoppiano wants to merge 14 commits intoleogao2:masterfrom

lfoppiano:master

Commits on Sep 29, 2023

ignore idea stuff

Luca Foppiano
authored and
Luca Foppiano
committed
add text_archive and decoupling data model and serialisation

Luca Foppiano
authored and
Luca Foppiano
committed
cleanup

Luca Foppiano
authored and
Luca Foppiano
committed
improving naming

Luca Foppiano
authored and
Luca Foppiano
committed

Commits on Nov 2, 2023

Merge pull request #1 from lfoppiano/decouple-output-model
lfoppiano
authored

Commits on Nov 4, 2023

Enable Github actions (#2)
lfoppiano
authored

Commits on Nov 5, 2023

update README

Luca Foppiano
authored and
Luca Foppiano
committed
add status badge

Luca Foppiano
authored and
Luca Foppiano
committed

Commits on Nov 6, 2023

correct how number of files already present is calculated

Luca Foppiano
authored and
Luca Foppiano
committed

Commits on Dec 4, 2023

stream data directly to the output when questions and answers are completed

Luca Foppiano
authored and
Luca Foppiano
committed
remove json format and use jsonl format with streaming directly in the output file

Luca Foppiano
authored and
Luca Foppiano
committed

Commits on Dec 6, 2023

fix extension for txt

Luca Foppiano
authored and
Luca Foppiano
committed
split archives when more than 10M records

Luca Foppiano
authored and
Luca Foppiano
committed

Commits on Dec 7, 2023

set the time at the creation of the archive so all the multiple files have the same timestamp

Luca Foppiano
authored and
Luca Foppiano
committed