I would like to fine-tune GPT-3 to produce a chatbot similar to ChatGPT based on all authoritative halachic question-answer pairs out there. There is a corpus on Sefaria and supposedly Bar-Ilan has a collection but I have not been able to find a publicly available version.
The Sefaria collection seems to be really modest. Surely, we should have at least a million recorded responsas including everything from the previous and from this century. It looks like I'm going to have to scrape sites like Chabad.org, Aish.com, Yeshiva.co etc. manually - recommendations of additional similar sites would be greatly appreciated too.
Please share any known resources with detailed answers to halachic questions. Any codex that indexes halachic rules would also work as long as the split between the "question" (something like "Laws of family purity", "List of kosher fish", "Morning blessings explained" would all be great questions for the purposes of training an AI model).
