Human Generated Data

Title

Untitled (group conversing)

Date

c. 1940

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1702

Human Generated Data

Title

Untitled (group conversing)

People

Artist: Joseph Woodson Whitesell, American 1876 - 1958

Date

c. 1940

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, 2.2002.1702

Machine Generated Data

Tags

Amazon
created on 2022-01-14

Sitting 100
Human 100
Person 99.6
Person 99.2
Person 98.6
Person 98.2
Person 95.7
Chair 93.8
Furniture 93.8
Chair 92.8
Person 92
Crowd 84.2
Face 78.5
Audience 75.2
Apparel 70.4
Clothing 70.4
People 67.4
Overcoat 64.9
Coat 64.9
Soldier 57.2
Military Uniform 57.2
Military 57.2
Photo 55.7
Photography 55.7
Person 50.1
Person 44.9

Clarifai
created on 2023-10-26

people 99.9
group 98.3
room 98.1
adult 97.2
furniture 96.9
man 95.6
group together 95.3
child 93.7
woman 93.2
sit 92.2
chair 92.1
recreation 89.7
indoors 89.4
many 89.4
seat 86.4
portrait 83.5
meeting 82.3
leader 82.2
boy 82.2
administration 81.7

Imagga
created on 2022-01-14

wind instrument 37.3
brass 36.4
musical instrument 36.4
man 32.9
people 30.1
male 24.8
person 24.5
adult 21.5
room 21.4
men 20.6
cornet 17.8
business 17.6
group 16.1
couple 15.7
black 15.6
office 15.4
businessman 15
chair 14.6
suit 14.4
women 14.2
classroom 14.2
indoors 14
stringed instrument 13.7
love 13.4
sitting 12.9
happiness 12.5
interior 12.4
attractive 11.9
indoor 11.9
device 11.5
bowed stringed instrument 11.3
meeting 11.3
teacher 11.3
sexy 11.2
modern 11.2
sax 11.2
professional 10.6
fashion 10.5
human 10.5
table 10.4
portrait 10.3
elegant 10.3
music 10.1
leisure 10
oboe 9.8
handsome 9.8
fun 9.7
together 9.6
looking 9.6
lifestyle 9.4
communication 9.2
cheerful 8.9
computer 8.9
body 8.8
hair 8.7
model 8.5
adults 8.5
hall 8.4
dark 8.3
entertainment 8.3
silhouette 8.3
window 8.2
stage 8.2
happy 8.1
team 8.1
romance 8
night 8
smiling 8
executive 7.9
party 7.7
pretty 7.7
drinking 7.6
talking 7.6
passion 7.5
style 7.4
inside 7.4
guitar 7.3
businesswoman 7.3
home 7.2
outfit 7.1
romantic 7.1
smile 7.1
family 7.1
posing 7.1

Google
created on 2022-01-14

Microsoft
created on 2022-01-14

person 98.9
music 94.4
sitting 94.3
clothing 90.9
text 90.9
furniture 87.9
musician 87.8
man 84.9
jazz 84.2
musical instrument 81.3
black 79.3
black and white 73.5
white 73.3
group 72.1
chair 68.5
people 64
old 42.5
crowd 0.9

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 56-64
Gender Male, 100%
Calm 88.4%
Sad 6.6%
Confused 1.5%
Happy 1.2%
Disgusted 0.8%
Angry 0.6%
Fear 0.6%
Surprised 0.3%

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 92%
Sad 2.3%
Confused 1.5%
Surprised 1.3%
Angry 1.2%
Fear 1.1%
Disgusted 0.5%
Happy 0.2%

AWS Rekognition

Age 35-43
Gender Male, 91.4%
Calm 91.7%
Angry 5.1%
Fear 1.8%
Happy 0.5%
Disgusted 0.3%
Sad 0.3%
Surprised 0.2%
Confused 0.1%

AWS Rekognition

Age 23-33
Gender Male, 95.9%
Calm 76.2%
Sad 7.5%
Fear 5.9%
Happy 3.8%
Disgusted 3.5%
Angry 1.4%
Surprised 1%
Confused 0.7%

AWS Rekognition

Age 54-64
Gender Female, 68.7%
Calm 54.9%
Sad 41.5%
Confused 1.1%
Angry 0.7%
Happy 0.5%
Disgusted 0.5%
Surprised 0.4%
Fear 0.4%

Microsoft Cognitive Services

Age 59
Gender Male

Microsoft Cognitive Services

Age 61
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Chair 93.8%