Skip to content

OSC/crawlee

Repository files navigation

NOTE: This is a fork of the UIUC chat's (web crawler)[https://github.com/Center-for-AI-Innovation/crawlee] adapted for OSC

OSC.chat's Web Crawler

Hosted on Railway.app. I found Railway preferable to severless functions because it easily handles the large bundle size introduced by using Chromium for full javascript execution during web crawling.

It's powered by the excellent Crawlee.dev

About

Hosting Crawlee to power hpcGPT

Resources

License

Stars

Watchers

Forks

Packages

 
 
 

Contributors