Human Generated Data

Title

Untitled (a Nawab?)
Date

c. 1860-1880
People

Artist: Willoughby Wallace Hooper, British 1837 - 1912
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.83

Human Generated Data

Title

Untitled (a Nawab?)

People

Artist: Willoughby Wallace Hooper, British 1837 - 1912

Date

c. 1860-1880

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Kenyon C. Bolton III Fund, 2018.83

Machine Generated Data

Tags

Amazon
created on 2019-04-10

Human 99.7
Person 99.7
Person 99.5
Person 99.4
Person 99.2
Person 98.1
Person 97.9
Person 96.8
Person 96
Person 95
Person 94.8
Person 91.2
Person 90
Person 86
Crowd 84.7
People 81.6
Person 78.6
Fireman 78
Person 74.5
Person 70.7
Person 66
Person 62.4
Person 42.2

Clarifai
created on 2018-10-18

people 100
many 99.7
group 99.6
adult 98.1
wear 96.7
man 96.6
military 95.9
group together 95.7
crowd 95.4
woman 95.1
child 95.1
war 94.5
soldier 93
administration 92.9
boy 90.9
leader 88.9
recreation 83.8
skirmish 80.5
education 79.3
several 78.9

Imagga
created on 2018-10-18

kin 64.5
people 20.6
uniform 19.3
statue 18.1
man 17.5
military 17.4
helmet 16.6
soldier 16.6
old 16
male 15
army 14.6
person 14.5
ancient 13.8
travel 13.4
war 12.5
sculpture 12.4
child 12.2
clothing 11.7
military uniform 11.5
monument 11.2
brass 10.9
tradition 10.2
architecture 10.1
stone 10.1
world 10.1
historic 10.1
danger 10
tourism 9.9
religion 9.9
history 9.8
building 9.8
group 9.7
weapon 9.5
men 9.4
culture 9.4
city 9.1
adult 9.1
art 9.1
vintage 9.1
private 8.9
family 8.9
warrior 8.8
gun 8.7
historical 8.5
hat 8.4
athlete 8.4
traditional 8.3
silhouette 8.3
sport 8.2
protection 8.2
landmark 8.1
antique 7.8
wall 7.7
armor plate 7.6
wind instrument 7.6
bearskin 7.6
tourist 7.4
player 7.4
new 7.3
industrial 7.3
room 7.2

Google
created on 2018-10-18

history 67.2
black and white 58
recreation 56.8
vintage clothing 53.8

Microsoft
created on 2018-10-18

person 99.9
group 96.3
old 90
posing 78
people 76.3
black 71.1
team 25.1
crowd 1.2

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-43
Gender Male, 87.2%
Confused 4.4%
Angry 3.9%
Surprised 1.7%
Disgusted 12.4%
Happy 1.7%
Calm 19.8%
Sad 56.2%

AWS Rekognition

Age 26-43
Gender Male, 53.9%
Surprised 45.6%
Disgusted 45.5%
Sad 46.3%
Confused 45.6%
Happy 45.8%
Angry 46.6%
Calm 49.5%

AWS Rekognition

Age 35-52
Gender Male, 53.8%
Calm 47.1%
Confused 45.4%
Sad 50.3%
Disgusted 45.5%
Happy 45.3%
Angry 46%
Surprised 45.3%

AWS Rekognition

Age 26-43
Gender Male, 80.3%
Disgusted 0.9%
Calm 60.5%
Surprised 1.2%
Angry 3.1%
Happy 1%
Sad 32.2%
Confused 1.2%

AWS Rekognition

Age 26-43
Gender Male, 54.2%
Confused 45.3%
Angry 45.3%
Disgusted 45.1%
Calm 53.1%
Happy 45.2%
Surprised 45.3%
Sad 45.6%

AWS Rekognition

Age 35-53
Gender Female, 50.9%
Sad 45.1%
Calm 53.1%
Happy 46.6%
Confused 45%
Disgusted 45%
Surprised 45.1%
Angry 45.1%

AWS Rekognition

Age 26-43
Gender Male, 53.7%
Sad 47.6%
Happy 45.2%
Confused 45.3%
Disgusted 45.2%
Surprised 45.2%
Angry 45.3%
Calm 51.1%

AWS Rekognition

Age 26-43
Gender Female, 51.6%
Sad 45.2%
Happy 47.7%
Surprised 45.1%
Disgusted 45.2%
Confused 45.1%
Angry 45.1%
Calm 51.6%

AWS Rekognition

Age 35-52
Gender Female, 51.5%
Confused 45.2%
Angry 45.4%
Sad 49%
Happy 49.1%
Calm 45.8%
Disgusted 45.2%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 51.7%
Disgusted 51%
Calm 45.6%
Surprised 45.3%
Angry 46.4%
Happy 45.4%
Sad 46.2%
Confused 45.2%

AWS Rekognition

Age 26-43
Gender Male, 60.5%
Disgusted 44.1%
Calm 43.4%
Sad 2.1%
Angry 2.4%
Confused 1.7%
Happy 2.9%
Surprised 3.3%

AWS Rekognition

Age 26-43
Gender Male, 84.1%
Angry 6.9%
Disgusted 0.5%
Happy 10.4%
Calm 13.9%
Sad 65%
Confused 1.2%
Surprised 2.1%

AWS Rekognition

Age 26-43
Gender Male, 51.3%
Confused 45.4%
Happy 45.4%
Calm 49.3%
Surprised 45.4%
Disgusted 45.6%
Sad 46%
Angry 47.8%

AWS Rekognition

Age 26-43
Gender Male, 52.9%
Surprised 45.2%
Disgusted 45.1%
Happy 45.3%
Sad 45.2%
Calm 54%
Confused 45.1%
Angry 45.2%

AWS Rekognition

Age 57-77
Gender Male, 77.7%
Confused 0.5%
Angry 0.8%
Happy 0.1%
Calm 95.3%
Disgusted 0.6%
Surprised 0.4%
Sad 2.2%

AWS Rekognition

Age 27-44
Gender Male, 51.4%
Calm 51.9%
Disgusted 45.6%
Surprised 45.8%
Angry 45.6%
Happy 45.1%
Confused 45.4%
Sad 45.7%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Disgusted 45.6%
Happy 47.3%
Surprised 45.2%
Sad 46.9%
Calm 49.4%
Angry 45.4%
Confused 45.1%

AWS Rekognition

Age 27-44
Gender Male, 52.8%
Confused 45.4%
Disgusted 45.5%
Calm 48.1%
Sad 49.5%
Surprised 45.5%
Happy 45.4%
Angry 45.7%

AWS Rekognition

Age 29-45
Gender Female, 52.2%
Confused 45.1%
Angry 45.4%
Surprised 45.1%
Disgusted 45.2%
Happy 45.1%
Calm 45.1%
Sad 54%

AWS Rekognition

Age 26-43
Gender Female, 52.5%
Confused 45.2%
Disgusted 45.9%
Sad 46.2%
Angry 45.8%
Calm 47.7%
Happy 48.5%
Surprised 45.7%

AWS Rekognition

Age 38-59
Gender Male, 50.5%
Surprised 45.6%
Confused 45.1%
Angry 45.2%
Happy 45.2%
Disgusted 45%
Sad 45.3%
Calm 53.5%

AWS Rekognition

Age 26-43
Gender Female, 53%
Confused 45.2%
Happy 48.4%
Calm 45.8%
Disgusted 45.4%
Angry 45.4%
Sad 49.5%
Surprised 45.3%

AWS Rekognition

Age 45-66
Gender Female, 53.9%
Disgusted 45.2%
Angry 45.8%
Confused 45.1%
Happy 46.9%
Calm 45.3%
Surprised 45.1%
Sad 51.6%

AWS Rekognition

Age 35-55
Gender Female, 50.4%
Confused 49.5%
Angry 49.5%
Surprised 49.5%
Disgusted 49.5%
Happy 49.7%
Calm 49.5%
Sad 50.2%

AWS Rekognition

Age 19-36
Gender Male, 54.8%
Confused 45.2%
Disgusted 45.1%
Sad 46.6%
Angry 45.5%
Calm 52.5%
Happy 45%
Surprised 45.1%

AWS Rekognition

Age 38-59
Gender Male, 52.1%
Angry 45.3%
Happy 49.4%
Calm 46.1%
Sad 48.4%
Surprised 45.4%
Confused 45.2%
Disgusted 45.2%

Microsoft Cognitive Services

Age 29
Gender Male

Microsoft Cognitive Services

Age 51
Gender Male

Microsoft Cognitive Services

Age 37
Gender Male

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 33
Gender Male

Microsoft Cognitive Services

Age 31
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 52
Gender Male

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft
created on 2018-10-18

a group of people posing for a photo 96.3%
an old photo of a group of people posing for the camera 95.2%
a group of people standing in front of a crowd posing for the camera 94.1%

Azure OpenAI

Created on 2024-11-17

In the image, there is a congregation of individuals gathered in what appears to be a courtyard or open-air setting with an architectural background that suggests it may be of historical significance. The architecture is characterized by arched doorways and intricate detail, indicative of traditional design. The individuals in the foreground seem to be seated on chairs or benches, while others stand in the background, possibly indicating a social or ceremonial event. The style of clothing varies among the individuals, with some wearing garments that suggest traditional attire, possibly from a past era. Overall, the setting and mode of dress convey a sense of historicity and cultural significance.

Anthropic Claude

Created on 2024-11-17

The image shows a large group of people gathered in what appears to be an archway or entryway of a building. The people are wearing a variety of traditional clothing and headwear, suggesting this is a scene from a different culture or time period. Some individuals are seated, while others are standing. The image has a historical feel to it, with the black and white tones and the formal, posed nature of the group. The architecture and dress of the people indicate this is likely an archival photograph from an earlier era.