Human Generated Data

Title

Untitled (two men and two women in formal wear sitting and chatting in elegant room)

Date

1949

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9245

Human Generated Data

Title

Untitled (two men and two women in formal wear sitting and chatting in elegant room)

People

Artist: Martin Schweig, American 20th century

Date

1949

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.3
Human 99.3
Person 98.1
Person 97.5
Person 97.3
Apparel 93.1
Clothing 93.1
People 75.5
Home Decor 71.6
Musician 68.4
Musical Instrument 68.4
Leisure Activities 64.1
Crowd 60.9
Stage 57.7

Imagga
created on 2022-01-23

wind instrument 40.4
brass 38.2
musical instrument 36.8
man 28.9
male 28.4
person 25.1
people 25.1
stage 20
men 19.7
adult 19.7
oboe 19.3
cornet 17.5
group 16.1
lifestyle 15.9
business 15.8
businessman 15
chair 13.4
leisure 13.3
platform 13.1
teacher 12.6
stringed instrument 12.6
silhouette 12.4
holding 12.4
black 12
life 12
room 11.8
job 11.5
couple 11.3
boy 11.3
music 11.1
women 11.1
woodwind 10.7
professional 10.7
happy 10
device 9.9
musician 9.8
sport 9.8
interior 9.7
indoors 9.7
sitting 9.4
youth 9.4
casual 9.3
executive 9.2
indoor 9.1
portrait 9.1
fun 9
to 8.8
office 8.8
performer 8.7
table 8.6
employee 8.6
dancer 8.4
relaxation 8.4
outdoors 8.2
businesswoman 8.2
cheerful 8.1
sunset 8.1
worker 8
smiling 8
work 7.8
concert 7.8
attractive 7.7
singer 7.7
relax 7.6
communication 7.6
friendship 7.5
girls 7.3
exercise 7.3
board 7.2
classroom 7.2
recreation 7.2
team 7.2
handsome 7.1
day 7.1
happiness 7
sky 7
together 7

Google
created on 2022-01-23

Chair 87.7
Black-and-white 84.6
Style 84
Dress 83.7
Line 81.5
Art 81.3
Picture frame 78.1
Monochrome photography 75.6
Monochrome 74.7
Suit 74.6
Vintage clothing 71.9
Room 70.4
Curtain 67.6
Event 64.9
Stock photography 64.2
Classic 63.6
Painting 63.3
History 63.1
Couch 62.7
Pattern 62.6

Microsoft
created on 2022-01-23

text 98.7
person 92.2
outdoor 91.9
clothing 91.1
musical instrument 57
footwear 55.3
woman 52.8

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 98.3%
Calm 89.2%
Happy 4.2%
Sad 2.5%
Confused 1.9%
Surprised 1.2%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.8%
Calm 86.8%
Sad 10.6%
Happy 1.2%
Confused 0.6%
Disgusted 0.3%
Angry 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Sad 43.9%
Surprised 39.8%
Fear 5.9%
Calm 4.3%
Confused 2.2%
Angry 1.6%
Disgusted 1.6%
Happy 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people standing in front of a building 88%
a group of people standing outside of a building 87.1%
a group of people performing on stage in front of a building 75.7%

Text analysis

Amazon

80

Google

EXEEE
EXEEE