Human Generated Data

Title

Untitled (women talking around couch by man playing piano)

Date

1941

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9024

Human Generated Data

Title

Untitled (women talking around couch by man playing piano)

People

Artist: Martin Schweig, American 20th century

Date

1941

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.1
Human 99.1
Person 98.9
Person 98.2
Person 97.8
Person 97.8
Person 96.8
Person 96.7
Clinic 96
Person 92.8
Person 92
Hospital 78.1
Person 75.5
Operating Theatre 73.4
Chair 70.2
Furniture 70.2
Person 68.8
Person 63.9
People 61.3
Indoors 60.1
Room 60.1
Person 56.6

Imagga
created on 2022-01-23

person 31.9
people 30.1
silhouette 27.3
male 26.9
dancer 25.9
men 25.8
man 25.5
adult 23.7
crowd 21.1
group 20.9
performer 19.1
professional 17.7
business 17.6
team 16.1
businessman 15.9
sport 15.2
entertainer 14.4
women 14.2
party 13.7
teacher 13.2
brass 13.1
fun 12.7
happiness 12.5
dance 12.5
leisure 12.4
negative 12.3
active 12.2
couple 12.2
human 12
happy 11.9
job 11.5
symbol 11.4
exercise 10.9
wind instrument 10.8
suit 10.8
stage 10.8
art 10.3
black 10.2
teamwork 10.2
event 10.2
lifestyle 10.1
worker 9.9
audience 9.7
film 9.7
athlete 9.6
design 9.6
boy 9.6
player 9.4
youth 9.4
friendship 9.4
educator 9.3
music 9.1
portrait 9.1
cheerful 8.9
sky 8.9
sexy 8.8
celebration 8.8
sea 8.7
silhouettes 8.7
love 8.7
work 8.6
executive 8.3
fashion 8.3
competition 8.2
girls 8.2
fitness 8.1
painting 8.1
world 8
body 8
platform 7.9
together 7.9
musical instrument 7.9
nighttime 7.8
sibling 7.8
flag 7.7
beach 7.7
patriotic 7.7
life 7.6
nation 7.6
photographic paper 7.5
businesswoman 7.3
smiling 7.2
dress 7.2
bright 7.1
handsome 7.1
child 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 98.1
person 91.2
black and white 66.3
clothing 63.5
old 59.6
group 58.7
man 57.1
posing 48.8

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Female, 63.3%
Calm 99.1%
Happy 0.4%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 45-53
Gender Male, 98.8%
Surprised 64%
Calm 13.8%
Confused 10%
Sad 3.9%
Happy 3.8%
Disgusted 2.3%
Fear 1.4%
Angry 0.7%

AWS Rekognition

Age 23-31
Gender Female, 94.8%
Calm 98.8%
Happy 0.3%
Surprised 0.3%
Confused 0.2%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 43-51
Gender Male, 98.7%
Surprised 56.7%
Sad 29.4%
Calm 9.8%
Confused 1.8%
Disgusted 0.9%
Angry 0.7%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 21-29
Gender Male, 67.6%
Calm 74.5%
Confused 12.2%
Surprised 3.4%
Angry 3.1%
Happy 2.7%
Sad 2.6%
Disgusted 0.9%
Fear 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Chair 70.2%

Captions

Microsoft

a group of people posing for a photo 71.6%
a group of people posing for the camera 71.5%
a group of people posing for a picture 71.4%