Boston Public Library aims to increase access to a vast historic archive using AI
Boston Public Library, one of the oldest and largest public library systems in the country, is launching a project this summer with OpenAI and Harvard Law School to make its trove of historically significant government documents more accessible to the public.
The documents date back to the early 1800s and include oral histories, congressional reports and surveys of different industries and communities.
“It really is an incredible repository of primary source materials covering the whole history of the United States as it has been expressed through government publications,” said Jessica Chapel, the Boston Public Library’s chief of digital and online services.
Currently, members of the public who want to access these documents must show up in person. The project will enhance the metadata of each document and will enable users to search and cross-reference entire texts from anywhere in the world.
Chapel said Boston Public Library plans to digitize 5,000 documents by the end of the year, and if all goes well, grow the project from there.
Making a bargain with AI
Because of this historic collection’s massive size and fragility, getting to this goal is a daunting process. Every item has to be run through a scanner by hand. It takes about an hour to do 300-400 pages.

Harvard University said it could help. Researchers at the Harvard Law School Library’s Institutional Data Initiative are working with libraries, museums and archives on a number of fronts, including training new AI models to help libraries enhance the searchability of their collections.
AI companies help fund these efforts, and in return get to train their large language models on high-quality materials that are out of copyright and therefore less likely to lead to lawsuits. (Microsoft and OpenAI are among the many AI players targeted by recent copyright infringement lawsuits, in which plaintiffs such as authors claim the companies stole their works without permission.)
“Having information institutions like libraries involved in building a sustainable data ecosystem for AI is critical, because it not just improves the amount of data we have available, it improves the quality of the data and our understanding of what’s in it,” said Burton Davis, vice president of Microsoft’s intellectual property group.
Access for all
Greg Leppert, the Harvard Law School Library’s Institutional Data Initiative’s executive director, said it is not the goal of the initiative to grant AI companies privileged access to the rich troves of out-of-copyright information held at libraries and archives. Anyone can have access to the data after it’s been digitized.
“It’s a two-way street, where we are improving data in a way that will help AI, but those improvements work their way back into the library,” said Leppert. “So it improves the patron experience as well.”
OpenAI is helping Boston Public Library cover such costs as scanning and project management. The tech company does not have exclusive rights to the digitized data.
“We benefit, like others, from their efforts to digitize the public domain, expanding the high-quality data and public knowledge that AI systems, including ours, can build on,” the company said in a statement to NPR.
Challenges of public-private partnerships
Library professionals say working with AI companies will provide broader access to information.
“ I think this is a really worthwhile partnership out of which we are going to get more accessible collections,” Boston Public Library’s Chapel said.
And, because librarians are involved in curating and categorizing that information, the integrity of the materials used by AI companies can be more easily protected.
“Having trained professionals with deep subject knowledge is crucial in this moment as we start to develop what the future will bring,” said American Library Association President Sam Helmick.
But library experts also expressed caution about these partnerships because of the cultural differences between public institutions and corporations.
“The kind of ‘move fast and break things’ ethos of Silicon Valley is counter to the values of librarianship, which are about access and transparency,” said Michael Hanegan, co-author of the new book Generative AI and Libraries.
“This is all moving so fast: The technology is moving fast. The companies are moving fast,” Chapel said. “And libraries work on a very different timescale. So there’s a little bit of a culture clash.”
Jennifer Vanasco edited this story for broadcast and digital.
Myanmar to hold first general election since 2021 coup amid ongoing civil war
With large parts of the country under opposition control amid an ongoing civil war, analysts warn that election logistics could prove challenging.
Newsmax pays $67 million to settle defamation case linked to 2020 election coverage
The right-wing news channel Newsmax has agreed to pay $67 million to Dominion Voting Systems over its coverage of the 2020 presidential election. A trial had been scheduled for October.
Researchers discover a secret weapon that saves babies’ lives. And it’s not medical
To save the lives of infants and small kids in lower resource countries, there are a handful of tools: anti-malarial drugs, bed nets and vaccines. A massive experiment in rural Kenya suggests another.
‘Can’t stop. Won’t stop’: Documentary filmmakers face federal funding shortfall
PBS has been a home for independent documentaries for more than 50 years. But with the closure of the Corporation for Public Broadcasting, nonfiction storytellers have to figure out a way forward.
What’s behind the Trump administration’s immigration memes?
White supremacist tropes and ironic viral jokes illustrate the administration's project of redefining who belongs in the United States.
Trump prompted a battle over voting maps. Here’s how redistricting affects voters
In a battle prompted by President Trump, Texas and California could redraw lines that change whose votes really matter in the 2026 congressional elections.