Human Generated Data

Title

Untitled (group photograph)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.91

Human Generated Data

Title

Untitled (group photograph)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.91

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Human 99
Person 99
Person 99
Person 98.9
Person 98.9
Person 98.7
Person 98.5
Person 97.6
Person 97.4
Person 96.5
Person 95.9
Art 95.8
Painting 95.8
Person 95.7
Person 95.4
People 94.6
Jury 85.8
Person 79.1
Person 73.1
Person 72.2
Person 70.7
Person 69
Family 67.8
Clothing 67.1
Apparel 67.1
Crowd 61
Court 57
Indoors 57
Room 57

Clarifai
created on 2018-04-19

people 99.9
group 99.4
many 99.1
administration 97.6
adult 97.1
woman 96.2
group together 95.1
man 94.3
wear 93.9
leader 93.2
military 91.8
chair 88
outfit 87.8
music 87.1
child 86.7
room 86.6
uniform 84.7
law 83
education 82
war 81.6

Imagga
created on 2023-10-30

kin 100
sculpture 27.8
statue 27.6
old 24.4
architecture 24.2
building 23.4
monument 22.4
ancient 20.7
tourism 20.6
travel 20.4
history 19.7
historic 19.2
art 17.7
historical 16
famous 15.8
city 15.8
landmark 15.3
stone 14.3
marble 13.6
people 13.4
culture 12.8
tourist 11.8
arch 11.6
religion 10.8
god 10.5
antique 10.4
man 10.1
vintage 9.1
decoration 8.8
urban 8.7
structure 8.6
male 8.5
balcony 8.5
traditional 8.3
detail 8
world 7.9
fountain 7.8
scene 7.8
palace 7.7
architectural 7.7
house 7.5
new 7.3
national 7.2
holiday 7.2
portrait 7.1
women 7.1

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

person 95.5
window 91.5
posing 90.5
old 80.2
people 77.4
group 58.9
picture frame 8.4

Color Analysis

Face analysis

Amazon

Microsoft

AWS Rekognition

Age 45-65
Gender Male, 54.2%
Angry 45.4%
Sad 45.4%
Disgusted 45.8%
Happy 45.7%
Calm 51.7%
Surprised 45.6%
Confused 45.4%

AWS Rekognition

Age 35-52
Gender Female, 54.4%
Calm 51.6%
Confused 45.1%
Disgusted 45%
Sad 48%
Happy 45.1%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Disgusted 45.2%
Happy 45.1%
Confused 45.4%
Calm 46.1%
Angry 46.5%
Surprised 45.1%
Sad 51.6%

AWS Rekognition

Age 26-43
Gender Female, 54.3%
Disgusted 45.1%
Happy 45.2%
Sad 47.8%
Confused 45.1%
Calm 45.1%
Surprised 45.1%
Angry 51.7%

AWS Rekognition

Age 26-43
Gender Female, 54.8%
Calm 51.6%
Disgusted 46%
Surprised 45.2%
Happy 45.4%
Sad 46.1%
Angry 45.5%
Confused 45.3%

AWS Rekognition

Age 48-68
Gender Female, 54.5%
Confused 45%
Calm 48.6%
Sad 45.1%
Happy 45.3%
Surprised 45.1%
Disgusted 50.7%
Angry 45.1%

AWS Rekognition

Age 35-52
Gender Female, 54.5%
Sad 53.4%
Confused 45.1%
Disgusted 45.3%
Calm 45.3%
Surprised 45.1%
Happy 45.1%
Angry 45.6%

AWS Rekognition

Age 14-23
Gender Female, 54.6%
Happy 45.1%
Angry 45.4%
Confused 45%
Calm 45%
Surprised 45%
Disgusted 45.1%
Sad 54.3%

AWS Rekognition

Age 60-80
Gender Female, 51.3%
Surprised 45.4%
Happy 48%
Sad 45.8%
Confused 45.5%
Angry 45.8%
Disgusted 47.1%
Calm 47.3%

AWS Rekognition

Age 35-52
Gender Male, 54.5%
Happy 45.5%
Angry 46.6%
Confused 45.6%
Calm 49.6%
Surprised 45.2%
Disgusted 45.7%
Sad 46.8%

AWS Rekognition

Age 35-55
Gender Male, 54.5%
Disgusted 45.2%
Confused 45.3%
Sad 48.3%
Surprised 45.1%
Calm 50.6%
Angry 45.4%
Happy 45.1%

AWS Rekognition

Age 35-52
Gender Male, 53.2%
Happy 45.2%
Angry 46.1%
Sad 45.7%
Surprised 45.4%
Disgusted 46.1%
Calm 50.5%
Confused 46%

AWS Rekognition

Age 45-63
Gender Male, 52%
Angry 45.5%
Sad 45.2%
Disgusted 52%
Surprised 45.4%
Calm 46.3%
Happy 45.3%
Confused 45.3%

AWS Rekognition

Age 30-47
Gender Male, 53.9%
Disgusted 45.7%
Calm 49.9%
Happy 45.2%
Surprised 46%
Sad 45.5%
Angry 46.1%
Confused 46.4%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Calm 51%
Surprised 45.3%
Confused 46.5%
Angry 46%
Sad 45.7%
Happy 45.3%
Disgusted 45.3%

AWS Rekognition

Age 26-44
Gender Female, 55%
Surprised 45.2%
Calm 51.3%
Happy 45.1%
Sad 47.9%
Confused 45.1%
Angry 45.3%
Disgusted 45.1%

AWS Rekognition

Age 38-59
Gender Male, 52.8%
Angry 46%
Calm 49.9%
Sad 45.7%
Surprised 45.9%
Confused 45.5%
Happy 45.4%
Disgusted 46.6%

AWS Rekognition

Age 45-63
Gender Male, 54.8%
Confused 45.4%
Angry 45.4%
Disgusted 45.7%
Sad 45.9%
Happy 45.5%
Calm 51.8%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Female, 54.6%
Angry 45%
Surprised 45%
Happy 45.1%
Calm 45%
Sad 54.7%
Confused 45%
Disgusted 45.1%

AWS Rekognition

Age 35-52
Gender Female, 50.5%
Sad 45.6%
Happy 45.1%
Calm 50.1%
Surprised 46.3%
Disgusted 46.6%
Confused 45.3%
Angry 45.9%

AWS Rekognition

Age 35-52
Gender Female, 54.1%
Surprised 45.4%
Angry 45.7%
Disgusted 45.7%
Sad 47.9%
Confused 45.3%
Happy 45.4%
Calm 49.7%

AWS Rekognition

Age 20-38
Gender Female, 54.8%
Confused 45%
Disgusted 45.1%
Surprised 45%
Angry 45%
Happy 45%
Sad 54.8%
Calm 45%

Microsoft Cognitive Services

Age 56
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 22
Gender Male

Microsoft Cognitive Services

Age 49
Gender Male

Microsoft Cognitive Services

Age 34
Gender Female

Microsoft Cognitive Services

Age 13
Gender Male

Microsoft Cognitive Services

Age 37
Gender Female

Microsoft Cognitive Services

Age 33
Gender Female

Microsoft Cognitive Services

Age 40
Gender Female

Microsoft Cognitive Services

Age 18
Gender Male

Microsoft Cognitive Services

Age 24
Gender Female

Microsoft Cognitive Services

Age 53
Gender Male

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 36
Gender Male

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 42
Gender Male

Feature analysis

Amazon

Person 99%
Painting 95.8%