Human Generated Data

Title

Untitled (group photograph)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.91

Human Generated Data

Title

Untitled (group photograph)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99
Person 99
Person 99
Person 98.9
Person 98.9
Person 98.7
Person 98.5
Person 97.6
Person 97.4
Person 96.5
Person 95.9
Art 95.8
Painting 95.8
Person 95.7
Person 95.4
People 94.6
Jury 85.8
Person 79.1
Person 73.1
Person 72.2
Person 70.7
Person 69
Family 67.8
Clothing 67.1
Apparel 67.1
Crowd 61
Room 57
Court 57
Indoors 57

Clarifai
created on 2018-04-19

people 99.9
group 99.4
many 99.1
administration 97.6
adult 97.1
woman 96.2
group together 95.1
man 94.3
wear 93.9
leader 93.2
military 91.8
chair 88
outfit 87.8
music 87.1
child 86.7
room 86.6
uniform 84.7
law 83
education 82
war 81.6

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

person 95.5
window 91.5
posing 90.5
old 80.2
people 77.4
group 58.9
picture frame 8.4

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Disgusted 45.2%
Happy 45.1%
Confused 45.4%
Calm 46.1%
Angry 46.5%
Surprised 45.1%
Sad 51.6%

AWS Rekognition

Age 45-65
Gender Male, 54.2%
Angry 45.4%
Sad 45.4%
Disgusted 45.8%
Happy 45.7%
Calm 51.7%
Surprised 45.6%
Confused 45.4%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Calm 51.6%
Confused 45.1%
Disgusted 45%
Sad 48%
Happy 45.1%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Disgusted 45.1%
Happy 45.2%
Sad 47.8%
Confused 45.1%
Calm 45.1%
Surprised 45.1%
Angry 51.7%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Calm 51.6%
Disgusted 46%
Surprised 45.2%
Happy 45.4%
Sad 46.1%
Angry 45.5%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Female, 54.5%
Confused 45%
Calm 48.6%
Sad 45.1%
Happy 45.3%
Surprised 45.1%
Disgusted 50.7%
Angry 45.1%

AWS Rekognition

Age 35-52
Gender Female, 54.5%
Sad 53.4%
Confused 45.1%
Disgusted 45.3%
Calm 45.3%
Surprised 45.1%
Happy 45.1%
Angry 45.6%

AWS Rekognition

Age 14-23
Gender Female, 54.6%
Happy 45.1%
Angry 45.4%
Confused 45%
Calm 45%
Surprised 45%
Disgusted 45.1%
Sad 54.3%

AWS Rekognition

Age 35-55
Gender Male, 54.5%
Disgusted 45.2%
Confused 45.3%
Sad 48.3%
Surprised 45.1%
Calm 50.6%
Angry 45.4%
Happy 45.1%

AWS Rekognition

Age 60-80
Gender Female, 51.3%
Surprised 45.4%
Happy 48%
Sad 45.8%
Confused 45.5%
Angry 45.8%
Disgusted 47.1%
Calm 47.3%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Happy 45.5%
Angry 46.6%
Confused 45.6%
Calm 49.6%
Surprised 45.2%
Disgusted 45.7%
Sad 46.8%

AWS Rekognition

Age 35-52
Gender Male, 53.2%
Happy 45.2%
Angry 46.1%
Sad 45.7%
Surprised 45.4%
Disgusted 46.1%
Calm 50.5%
Confused 46%

AWS Rekognition

Age 45-63
Gender Male, 52%
Angry 45.5%
Sad 45.2%
Disgusted 52%
Surprised 45.4%
Calm 46.3%
Happy 45.3%
Confused 45.3%

AWS Rekognition

Age 30-47
Gender Male, 53.9%
Disgusted 45.7%
Calm 49.9%
Happy 45.2%
Surprised 46%
Sad 45.5%
Angry 46.1%
Confused 46.4%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Calm 51%
Surprised 45.3%
Confused 46.5%
Angry 46%
Sad 45.7%
Happy 45.3%
Disgusted 45.3%

AWS Rekognition

Age 26-44
Gender Female, 55%
Surprised 45.2%
Calm 51.3%
Happy 45.1%
Sad 47.9%
Confused 45.1%
Angry 45.3%
Disgusted 45.1%

AWS Rekognition

Age 38-59
Gender Male, 52.8%
Angry 46%
Calm 49.9%
Sad 45.7%
Surprised 45.9%
Confused 45.5%
Happy 45.4%
Disgusted 46.6%

AWS Rekognition

Age 45-63
Gender Male, 54.8%
Confused 45.4%
Angry 45.4%
Disgusted 45.7%
Sad 45.9%
Happy 45.5%
Calm 51.8%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 54.6%
Angry 45%
Surprised 45%
Happy 45.1%
Calm 45%
Sad 54.7%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Sad 45.6%
Happy 45.1%
Calm 50.1%
Surprised 46.3%
Disgusted 46.6%
Confused 45.3%
Angry 45.9%

AWS Rekognition

Age 35-52
Gender Female, 54.1%
Surprised 45.4%
Angry 45.7%
Disgusted 45.7%
Sad 47.9%
Confused 45.3%
Happy 45.4%
Calm 49.7%

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Confused 45%
Disgusted 45.1%
Surprised 45%
Angry 45%
Happy 45%
Sad 54.8%
Calm 45%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 13
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Feature analysis

Amazon

Person 99%
Painting 95.8%

Captions

Microsoft

a group of people posing for a photo in front of a window 97.2%
a vintage photo of a group of people posing for the camera 97.1%
a group of people posing for a photo 97%