Human Generated Data

Title

Untitled (musicians)

Date

c. 1860-1880

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.79

Human Generated Data

Title

Untitled (musicians)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.79

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Person 99.8
Human 99.8
Person 99.7
Person 99.3
Person 98.7
Painting 97.9
Art 97.9
Military 80.1
Military Uniform 78.9
Clothing 68.3
Apparel 68.3
Outdoors 65.7
Nature 56.8
Soldier 56.7
Officer 55.7

Clarifai
created on 2018-10-18

people 100
group 99.9
adult 99.9
wear 99.5
two 99.4
group together 98.9
man 98.7
three 98.5
many 98
military 97.9
one 97.5
four 97.2
several 97.1
veil 96.8
woman 96
vehicle 95.6
outfit 95.3
five 94.4
administration 93.8
portrait 93.7

Imagga
created on 2018-10-18

wicker 34.3
work 24.3
hovel 23.6
product 19.9
travel 18.3
religion 17.9
old 16
architecture 14.8
creation 13.9
holiday 12.9
art 12.7
history 11.6
sky 11.5
earth 11.2
culture 11.1
building 10.9
traditional 10.8
tourism 10.7
structure 10.6
ancient 10.4
tree 10
tower 9.8
vacation 9.8
statue 9.7
hut 9.6
sculpture 9.4
shelter 9.3
world 9
man 8.7
scary 8.7
temple 8.7
dark 8.3
globe 8.3
outdoors 8.2
antique 8
season 7.8
golden 7.7
god 7.6
religious 7.5
city 7.5
famous 7.4
church 7.4
person 7.3
grass 7.1

Google
created on 2018-10-18

Microsoft
created on 2018-10-18

wall 97.2
old 92.7
posing 68.3
people 59.2
stone 40.7
helmet 23.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 90.5%
Surprised 3.1%
Disgusted 13%
Happy 3.8%
Angry 18.1%
Calm 35%
Sad 20.5%
Confused 6.6%

AWS Rekognition

Age 35-52
Gender Female, 56.4%
Disgusted 17.7%
Angry 4.3%
Sad 65.7%
Surprised 0.9%
Confused 5.3%
Happy 1.9%
Calm 4.2%

AWS Rekognition

Age 57-77
Gender Male, 74.9%
Happy 21%
Sad 52.7%
Disgusted 1.3%
Confused 3.6%
Angry 3%
Surprised 1.7%
Calm 16.8%

AWS Rekognition

Age 35-52
Gender Female, 51.6%
Disgusted 43.3%
Happy 6.7%
Surprised 3.3%
Angry 11%
Calm 28.2%
Confused 3%
Sad 4.5%

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Painting 97.9%

Captions

Azure OpenAI

Created on 2024-11-19

The image depicts a group of individuals in traditional attire, standing and sitting against a plain backdrop. They are holding musical instruments that include a wind instrument and two types of drums. Despite being an old photograph, the details on the traditional costumes and instruments are quite visible, suggesting they may be performers or part of a cultural ensemble. The sepia tone of the image indicates its historical nature, and the arch shape at the top is typical of photographs from the late 19th to early 20th century. The individuals appear to be in a posed setting, likely for a portrait or ethnographic documentation.

Anthropic Claude

Created on 2024-11-19

The image appears to depict four Indigenous people from what seems to be an African or Asian culture. Two of the individuals are standing, wearing traditional clothing and adornments such as beaded necklaces and headdresses. The other two individuals are seated, also wearing traditional attire and holding what appear to be woven baskets or containers. The overall scene suggests the documentation of an Indigenous cultural group and their traditional practices or way of life.