AI in the Museum: Connecting Futures
Introduction As part of our series exploring how AI is being implemented in museums worldwide, this case study focuses on the “Photo Detective” project at the Archäologisches Museum Hamburg (AMH). Led by Michael Merkel, this initiative tackles a common challenge for cultural institutions: managing vast collections of analogue photographs. While the AMH has digitized approximately 75% of its collection, the lack of detailed metadata makes these archives difficult for researchers and curators to navigate. Funded as a Proof of Concept by the InnotechHH Fund, “Photo Detective” uses automated tagging to transform these static images into a highly searchable digital resource. The Technological Dimension Object and Context Recognition The core of “Photo Detective” is an AI system driven by object recognition. The model was developed using a training set of 2,613 hand-annotated images. While the team considered 37 different object classes during the labeling phase, 21 classes were ultimately included in the final training model. The AI is capable of identifying a wide range of elements, from high-frequency subjects like “people” and “cars” to more specific architectural features like “timber framing,” “thatch roofs,” and “lattice windows.” Beyond identifying individual objects, the project explores context detection. For example, by recognizing specific clusters of objects—such as sports equipment or crowds—the AI can identify “sports events” as a general context. Remarkably, the technology’s potential extends beyond standard photography, successfully tagging historical engravings and postcards that include printed text. The “Human-in-the-Loop” Workflow A defining characteristic of this project is its “Human-in-the-Loop” centered workflow, which ensures that machine efficiency is balanced with human expertise. This six-step cycle creates a continuous loop of improvement: 1. Data Annotation: Humans manually label training data in a dedicated application. 2. Training: This data is used to teach the machine learning model. 3. Evaluation: Professionals assess the model’s performance to ensure the quality of predictions. 4. Hosting: The validated model is hosted on the “Photo Detective” platform. 5. Bulk Processing: Users initiate the automated tagging of large datasets. 6. Feedback: Ongoing user feedback is fed back into the database to refine future training phases. Impacts on the Cultural Sector The implementation of “Photo Detective” is reshaping several areas of museum practice: • Institutional Management: By automating the labeling process, the museum significantly reduces the administrative burden of archival processing, allowing staff to focus on high-level curation. • Knowledge Sharing: In a move toward collaborative innovation, the AMH plans to make its training data available as “open data” for other cultural institutions, helping the wider sector develop similar tools. • Research and Mediation: Enhanced searchability allows researchers to find specific historical details, such as every image featuring a “horse” or a “shop window”, instantly, opening new doors for historical analysis and public engagement. Perspectives and Issues The “Photo Detective” project highlights the shifting role of the museum professional in the age of AI. While the tool offers immense speed, the “Human-in-the-Loop” approach is essential to address the opacity of machine-generated interpretations. It ensures that the final tags remain accurate and contextually relevant. Additionally, as museums become more dependent on these digital tools, questions regarding the long-term sustainability of the technology and the standardization of data across different institutions remain at the forefront of the discussion. Conclusion The Archäologisches Museum Hamburg demonstrates how AI can revitalize historical archives. By combining automated object recognition with a rigorous human oversight process, “Photo Detective” makes history more accessible and participatory. This case serves as a model for how museums can use technology not just to store the past, but to make it a searchable and living resource for the 21st century. Links Archäologisches Museum Hamburg: https://amh.de [https://amh.de] Michael Merkel on LinkedIn: https://www.linkedin.com/in/michael-merkel-8759bb13/ [https://www.linkedin.com/in/michael-merkel-8759bb13/] Get full access to MuseumWeek Magazine at museumweek2h1r4.substack.com/subscribe [https://museumweek2h1r4.substack.com/subscribe?utm_medium=podcast&utm_campaign=CTA_4]
15 episodios
Comentarios
0Sé la primera persona en comentar
¡Regístrate ahora y únete a la comunidad de AI in the Museum: Connecting Futures!