Bart: A vintage llm
Summary
Unbounded Labs released Bart, a small language model trained from scratch on English text written before the nineteen thirties, with no modern material in the corpus at all. The team published a working chat demo, the model weights on Hugging Face, and a public code repository, alongside a long write up of how they built it.
The write up covers where the corpus came from, how they cut a large historical book collection down to a usable training set, the benchmark suite they had to build because nothing existed for models of this kind, the ablations and training runs, the post training work, and the errors they made. The stated research question is whether a model limited to older knowledge can arrive at ideas that came after its cutoff, or whether it only recombines what it was shown. The post ends with an open request for compute, funding, and mentors.
Why it matters
This is a controlled demonstration that a model knows only what its training corpus contains, and nothing else. Everything the model can say about any subject, including a company, a product, or a category, is bounded by the text that survived collection and cleaning. The build account is unusually specific about the cleaning stage, where most of a source collection gets discarded before any question of retrieval or citation comes up. For anyone trying to be found, understood, cited, or recommended by AI systems, that stage is the one nobody sees: material that is thin, duplicated, poorly structured, or absent from the sources a corpus draws on never reaches the model, and no amount of later optimisation recovers it. Being in the corpus, in a form that survives filtering, comes before being retrieved.
Source
- unboundedlab.com/chat/bartholomew the item itself, published by r/LocalLLaMA, created by soggydoggy8
- github.com/zachnorton14/bartholomew Public source code or repository
- www.unboundedlab.com/blog/bartholomew Reproducible first-party demonstration, first party
- huggingface.co/jbduran/bartholomew-sft Original dataset with disclosed methods
- reddit.com/r/LocalLLaMA/comments/1vx7aci/bart_a_vintage_llmwhere AIOTruth found it
What was checked
- read the item page (200)
- https://github.com/zachnorton14/bartholomew: supports the item, tier 6 (Public source code or repository)
- https://www.unboundedlab.com/blog/bartholomew: supports the item, tier 2 (Reproducible first-party demonstration)
- https://www.unboundedlab.com/chat/bartholomew: does not mention the item, tier 8 (Named expert analysis, or a first-party claim about itself)
- https://huggingface.co/jbduran/bartholomew-sft: supports the item, tier 5 (Original dataset with disclosed methods)
Limitations
- Reddit engagement is a discovery signal here, not evidence that the claim is correct.
AIOTruth judgment
Evidence status is Confirmed, and it is unusually well supported for a discovery item: the working demo, the published weights, the source repository, and the first party build account were all fetched and all discuss the same work. That combination is why the evidence and usefulness dimensions both scored at the top of the range, and why originality scored close to it: the approach of deliberately constraining a corpus by date, and building a benchmark suite for it, is not a repackaging of existing work. Relevance is the one dimension that scored low, and it is the reason the overall value lands where it does rather than higher: this is a research project about model capability, not about brand visibility, and the connection to discovery is inferred rather than argued by the authors. Reddit engagement here is a discovery signal only, not evidence that any claim in the post is correct.
How this score was calculated
| Dimension | Weight | Score | What produced it |
|---|---|---|---|
| AIO relevance | 30% | 3 | no beat terms matched; 2 scope question(s) matched |
| Usefulness | 30% | 10 | 2 artifact(s), 5 actionable marker(s), 1 measured figure(s) |
| Evidence | 25% | 10 | Reproducible first-party demonstration; 3 verified source(s) across 3 domain(s) |
| Originality | 15% | 9 | carries original testing or data; closest archive match 0 |
aioRelevance x 0.30 + usefulness x 0.30 + evidence x 0.25 + originality x 0.15. The rubric is published in full on the Editorial Method page. Scoring is deterministic: the same item scores the same on every run.
Read the source Open the source
Found something wrong here? AIOTruth corrects material errors openly. Have something we should review? Submit a find.