Human Generated Data

Title

Untitled (people eating at party, large stuffed bear in room)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17205

Human Generated Data

Title

Untitled (people eating at party, large stuffed bear in room)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17205

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.6
Human 99.6
Person 99.4
Person 99.2
Person 98.9
Person 98.9
Person 98.1
Person 96.3
Person 95.9
Sunglasses 94.9
Accessories 94.9
Accessory 94.9
Person 92.1
Person 86.3
Table 85.2
Furniture 85.2
People 81.7
Face 81.5
Crowd 79.6
Pc 77.2
Computer 77.2
Electronics 77.2
Clothing 73
Apparel 73
Indoors 72.3
Meal 70.1
Food 70.1
Room 68.3
Monitor 68.1
Display 68.1
Screen 68.1
Dining Table 66.9
Photography 66.1
Photo 66.1
Person 65.2
Female 64.4
LCD Screen 64.3
Girl 64.2
Portrait 63.8
Suit 62.6
Coat 62.6
Overcoat 62.6
Sitting 58.9
Couch 58.1

Clarifai
created on 2023-10-29

people 99.8
group 98.8
many 98.1
adult 96.4
music 96.2
administration 95.9
group together 95.9
child 94.1
man 93.8
woman 92.7
musician 92
audience 89
boy 88.5
recreation 87.3
war 85.5
furniture 84.7
leader 84.2
military 82.3
instrument 82.1
education 81.4

Imagga
created on 2022-02-26

marimba 39.7
percussion instrument 33.7
man 33.6
musical instrument 32.3
people 26.8
person 25.9
senior 25.3
adult 23.5
teacher 23.1
male 22
old 19.5
sitting 18.9
happy 18.2
smiling 16.6
classroom 16.2
couple 15.7
room 15.3
spectator 15
portrait 14.9
professional 14
blackboard 14
elderly 13.4
group 12.9
aged 12.7
women 12.6
educator 12.6
mature 12.1
face 12.1
men 12
happiness 11.7
retirement 11.5
cheerful 11.4
school 11.1
business 10.9
retired 10.7
hand 10.6
student 10.5
together 10.5
looking 10.4
education 10.4
home 10.4
love 10.2
smile 10
indoor 9.1
computer 8.8
office 8.8
businessman 8.8
indoors 8.8
lifestyle 8.7
table 8.6
chair 8.6
casual 8.5
enjoyment 8.4
black 8.4
laptop 8.4
color 8.3
holding 8.2
outdoors 8.2
to 8
day 7.8
class 7.7
married 7.7
outdoor 7.6
togetherness 7.5
meeting 7.5
vintage 7.4
technology 7.4
executive 7.4
hair 7.1

Google
created on 2022-02-26

Black 89.6
Black-and-white 86.3
Style 84.1
Hat 83.1
Monochrome 80
Adaptation 79.3
Monochrome photography 79.1
Art 77.9
Event 73.3
Crew 72.9
Crowd 67.3
Room 63.7
History 62.7
Team 62.7
Stock photography 61.9
Vintage clothing 61.6
Musician 60
Music 60
T-shirt 57.9
Illustration 57.7

Microsoft
created on 2022-02-26

person 99.7
human face 86.9
text 85.8
clothing 85.3
black and white 81.3
group 80.6
man 80.5
people 72.2
crowd 0.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 24-34
Gender Male, 98.4%
Calm 96%
Surprised 1.5%
Happy 1.1%
Fear 0.6%
Confused 0.5%
Disgusted 0.2%
Sad 0.1%
Angry 0.1%

AWS Rekognition

Age 18-26
Gender Male, 69.7%
Happy 77.7%
Calm 20.1%
Surprised 0.6%
Sad 0.5%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 45-51
Gender Male, 88.8%
Calm 99.4%
Happy 0.5%
Sad 0%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Female, 96%
Calm 99.7%
Sad 0.2%
Angry 0%
Confused 0%
Disgusted 0%
Happy 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 24-34
Gender Male, 100%
Calm 99.5%
Happy 0.1%
Sad 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 43-51
Gender Male, 96.4%
Calm 99.6%
Sad 0.3%
Happy 0%
Surprised 0%
Disgusted 0%
Angry 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Sunglasses
Person 99.6%
Person 99.4%
Person 99.2%
Person 98.9%
Person 98.9%
Person 98.1%
Person 96.3%
Person 95.9%
Person 92.1%
Person 86.3%
Person 65.2%
Sunglasses 94.9%

Categories

Imagga

paintings art 94.7%
interior objects 2.1%

Text analysis

Amazon

DAY