Human Generated Data

Title

Untitled (large group around Christmas tree in livingroom with Santa Claus)
Date

c. 1935-1938, printed later
People

Artist: Durette Studio, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5869

Human Generated Data

Title

Untitled (large group around Christmas tree in livingroom with Santa Claus)

People

Artist: Durette Studio, American 20th century

Date

c. 1935-1938, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5869

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99.2
Person 99.2
Person 97.5
Indoors 97.3
Room 97.3
Person 97.1
Person 97
Person 96.3
Person 95.7
Person 92.7
Crowd 92.2
Person 91.5
Audience 91.3
Classroom 91.2
School 91.2
Person 90.7
Person 89.7
Person 89.6
Person 89.5
Person 87.9
People 87
Person 82.7
Person 82.6
Interior Design 81
Person 80.1
Person 68.9
Person 68.4
Accessories 67.3
Accessory 67.3
Tie 67.3
Person 67.2
Person 61
Workshop 59.9
Lecture 56.2
Speech 56.2
Musical Instrument 55.3
Musician 55.3
Seminar 55.1
Person 47.5
Person 46.3

Clarifai
created on 2019-11-16

people 100
group 99.8
many 99.6
adult 98.7
group together 98.6
furniture 97.2
woman 95.7
man 95.2
administration 94.7
leader 94.5
sit 94.4
crowd 94.4
child 93.4
chair 92.8
seat 92
room 89.4
wear 88.8
boy 88.3
audience 88.2
recreation 86.1

Imagga
created on 2019-11-16

gymnasium 30.1
athletic facility 24.2
grunge 23.8
man 19.7
facility 19.7
silhouette 18.2
black 17
people 16.2
kin 15.9
art 15.2
person 14.5
decoration 13.6
design 13.5
male 13.5
money 12.7
currency 12.5
old 11.8
pattern 11.6
vintage 11.6
business 10.9
play 10.3
paint 9.9
dirty 9.9
sport 9.9
team 9.8
graphic 9.5
symbol 9.4
happy 9.4
child 9.4
dollar 9.3
retro 9
postmark 8.9
boy 8.8
stamp 8.7
ink 8.7
mail 8.6
poster 8.5
portrait 8.4
texture 8.3
banking 8.3
cash 8.2
game 8.2
aged 8.1
drawing 8.1
card 7.8
dance 7.7
men 7.7
frame 7.6
clip art 7.4
closeup 7.4
competition 7.3
success 7.2
adult 7.1
financial 7.1
paper 7

Google
created on 2019-11-16

Photograph 96.6
Snapshot 86.5
Black-and-white 84.2
Room 78
Photography 76.4
Stock photography 68.5
Art 67.7
Monochrome 64.3
Photographic paper 60.6
Monochrome photography 57.8
Team 52.3
Picture frame 50.8

Microsoft
created on 2019-11-16

person 99.3
text 98.6
posing 98.4
clothing 97.1
group 94.7
man 86.5
people 78.2
old 72.3
funeral 71
woman 54.1
crowd 0.7

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 18-30
Gender Female, 51.9%
Angry 45.3%
Surprised 45%
Sad 45.2%
Happy 45%
Disgusted 45%
Confused 45%
Calm 54.3%
Fear 45%

AWS Rekognition

Age 23-35
Gender Female, 50.2%
Happy 45.6%
Disgusted 45%
Fear 45%
Calm 53.8%
Confused 45.1%
Sad 45.2%
Surprised 45.1%
Angry 45.2%

AWS Rekognition

Age 22-34
Gender Male, 53.5%
Confused 45%
Sad 45%
Happy 52.8%
Angry 45.1%
Fear 45%
Disgusted 45.1%
Calm 47%
Surprised 45%

AWS Rekognition

Age 33-49
Gender Female, 53.6%
Angry 45%
Fear 45%
Disgusted 45%
Sad 45%
Confused 45%
Calm 54.5%
Happy 45.4%
Surprised 45%

AWS Rekognition

Age 26-40
Gender Female, 54.6%
Calm 54.4%
Angry 45.1%
Surprised 45%
Disgusted 45.3%
Happy 45%
Sad 45.1%
Fear 45%
Confused 45%

AWS Rekognition

Age 12-22
Gender Male, 53.1%
Surprised 45.1%
Calm 54.5%
Happy 45.2%
Angry 45.1%
Fear 45%
Sad 45.1%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 34-50
Gender Female, 53.5%
Happy 46.8%
Fear 45%
Sad 45%
Confused 45%
Disgusted 45%
Surprised 45%
Calm 52.9%
Angry 45.1%

AWS Rekognition

Age 13-23
Gender Female, 54.2%
Surprised 45.7%
Sad 45.1%
Confused 45.1%
Happy 52.9%
Disgusted 45.1%
Fear 45.9%
Angry 45.1%
Calm 45.1%

AWS Rekognition

Age 21-33
Gender Male, 54.8%
Fear 45%
Surprised 45%
Confused 45%
Sad 45.1%
Disgusted 45%
Happy 54.1%
Calm 45.7%
Angry 45.1%

AWS Rekognition

Age 17-29
Gender Male, 51.8%
Surprised 46.8%
Angry 45.2%
Happy 45%
Fear 45.3%
Calm 46.6%
Disgusted 45.1%
Sad 45.9%
Confused 50%

AWS Rekognition

Age 36-52
Gender Female, 52.9%
Happy 45%
Surprised 45%
Fear 45%
Calm 55%
Angry 45%
Sad 45%
Confused 45%
Disgusted 45%

AWS Rekognition

Age 16-28
Gender Male, 53.4%
Fear 45.3%
Calm 48.6%
Disgusted 45.1%
Angry 48.6%
Surprised 45.5%
Happy 46.2%
Sad 45.5%
Confused 45.2%

AWS Rekognition

Age 38-56
Gender Male, 50.8%
Surprised 45.7%
Fear 45%
Angry 45.2%
Happy 45%
Sad 45%
Confused 45.1%
Calm 53.8%
Disgusted 45.2%

AWS Rekognition

Age 28-44
Gender Male, 53.5%
Disgusted 45%
Sad 45%
Fear 45%
Angry 45.2%
Confused 45%
Happy 54.2%
Calm 45.4%
Surprised 45.1%

AWS Rekognition

Age 6-16
Gender Female, 53.1%
Angry 45.1%
Surprised 45.1%
Sad 45%
Happy 45.7%
Calm 53.9%
Fear 45%
Confused 45.1%
Disgusted 45.1%

AWS Rekognition

Age 11-21
Gender Male, 51%
Disgusted 45.1%
Calm 47.8%
Angry 46.3%
Confused 45.4%
Fear 45.2%
Sad 50.2%
Surprised 45%
Happy 45%

AWS Rekognition

Age 18-30
Gender Female, 54.3%
Calm 45%
Fear 48.3%
Sad 45%
Happy 46.5%
Disgusted 45%
Surprised 50.1%
Confused 45%
Angry 45.1%

AWS Rekognition

Age 7-17
Gender Male, 50.3%
Sad 53.9%
Calm 45.4%
Angry 45.1%
Fear 45.4%
Happy 45.1%
Surprised 45%
Disgusted 45%
Confused 45.1%

AWS Rekognition

Age 8-18
Gender Male, 50.1%
Surprised 45.2%
Fear 45.1%
Disgusted 45%
Calm 45.2%
Angry 45.1%
Confused 45%
Happy 54.4%
Sad 45.1%

AWS Rekognition

Age 3-11
Gender Female, 51.7%
Disgusted 45%
Happy 45%
Angry 54.7%
Fear 45%
Calm 45.1%
Sad 45%
Surprised 45.1%
Confused 45%

AWS Rekognition

Age 16-28
Gender Female, 54.1%
Fear 45%
Happy 47%
Calm 52.4%
Surprised 45.2%
Disgusted 45.1%
Angry 45.1%
Sad 45.1%
Confused 45.1%

AWS Rekognition

Age 7-17
Gender Male, 50.8%
Calm 53.5%
Confused 45.1%
Happy 45.1%
Surprised 45%
Sad 45.8%
Fear 45.1%
Angry 45.4%
Disgusted 45.1%

AWS Rekognition

Age 12-22
Gender Female, 51.8%
Disgusted 45.1%
Angry 45.1%
Confused 45.1%
Calm 51%
Sad 45.2%
Happy 48.1%
Surprised 45.2%
Fear 45.1%

AWS Rekognition

Age 22-34
Gender Male, 54.4%
Disgusted 45.9%
Calm 45.1%
Angry 45.1%
Confused 45.6%
Fear 51.5%
Sad 45%
Surprised 46.8%
Happy 45%

AWS Rekognition

Age 33-49
Gender Female, 51.6%
Calm 54.3%
Fear 45%
Angry 45.1%
Disgusted 45%
Sad 45.3%
Happy 45.1%
Surprised 45.1%
Confused 45.2%

AWS Rekognition

Age 23-35
Gender Female, 50.2%
Angry 49.5%
Happy 49.5%
Disgusted 50.5%
Calm 49.5%
Fear 49.5%
Surprised 49.5%
Sad 49.5%
Confused 49.5%

Microsoft Cognitive Services

Age 12
Gender Female

Microsoft Cognitive Services

Age 22
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 13
Gender Male

Microsoft Cognitive Services

Age 26
Gender Female

Microsoft Cognitive Services

Age 30
Gender Female

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 29
Gender Female

Microsoft Cognitive Services

Age 25
Gender Male

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Tie 67.3%

Categories

Imagga

paintings art 48.1%
people portraits 37.9%
food drinks 5.3%
interior objects 4.9%

Text analysis

Amazon

X