Human Generated Data

Title

Untitled (man and woman sitting in front of fireplace)
Date

1955, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.211

Human Generated Data

Title

Untitled (man and woman sitting in front of fireplace)

People

Artist: Martin Schweig, American 20th century

Date

1955, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.5
Person 99.5
Furniture 99.3
Room 98.9
Indoors 98.9
Person 98.2
Sitting 97.3
Living Room 96.8
Chair 96.8
Waiting Room 95.5
Chair 92.7
Couch 88.7
Person 88.5
Reception Room 79
Reception 79
Accessory 67.8
Tie 67.8
Accessories 67.8
Clothing 62.5
Apparel 62.5
Shoe 58.3
Footwear 58.3
Armchair 56.5

Imagga
created on 2022-01-08

office 40.5
businessman 34.4
man 34.3
male 33.4
room 32.8
business 31.6
person 30.9
table 29.1
people 27.9
professional 27.5
teacher 26.4
computer 26.3
work 25.1
meeting 24.5
laptop 24.5
group 24.2
sitting 24.1
executive 23.4
desk 22.3
working 22.1
adult 21.3
smiling 21
musical instrument 20.3
indoors 20.2
corporate 19.8
men 18.9
happy 18.8
communication 18.5
team 17.9
interior 17.7
businesswoman 17.3
suit 17.2
job 16.8
conference 16.6
talking 16.2
modern 16.1
home 16
women 15.8
chair 15.8
together 14.9
looking 14.4
classroom 14.1
manager 14
mature 14
teamwork 13.9
educator 13.7
lifestyle 13
stringed instrument 12.9
indoor 12.8
restaurant 12.6
handsome 12.5
wind instrument 12.4
businesspeople 12.3
couple 12.2
worker 12.2
smile 12.1
presentation 12.1
entrepreneur 12
confident 11.8
portrait 11.7
success 11.3
bowed stringed instrument 11.1
successful 11
colleagues 10.7
cheerful 10.6
education 10.4
happiness 10.2
phone 10.1
occupation 10.1
workplace 9.5
student 9.5
showing 9.4
house 9.2
technology 8.9
furniture 8.8
discussion 8.8
boss 8.6
company 8.4
board 8.2
design 7.9
oboe 7.8
partners 7.8
full length 7.8
couch 7.7
corporation 7.7
mid adult 7.7
leader 7.7
two 7.6
adults 7.6
career 7.6
learning 7.5
holding 7.4
coffee 7.4
training 7.4
life 7.3
new 7.3
love 7.1
building 7.1
hall 7
monitor 7

Google
created on 2022-01-08

Picture frame 93.8
Chair 90.1
Dress 87.5
Style 83.9
Suit 76.9
Classic 74.7
Vintage clothing 73.1
Font 72.6
Monochrome photography 71.7
Event 70.1
Monochrome 70
Table 67.1
Sitting 66.9
Room 65
Stock photography 62.8
History 62.4
Formal wear 59.6
Rectangle 59.2
Art 58.7
Couch 58.4

Microsoft
created on 2022-01-08

wall 99.3
text 97.8
indoor 95.8
chair 91.3
clothing 81.6
person 75.9
table 64.4
room 59.8
old 45.5
furniture 19

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 38-46
Gender Female, 99.2%
Calm 58.7%
Happy 25%
Fear 6.7%
Disgusted 4.1%
Surprised 1.9%
Sad 1.6%
Angry 1.3%
Confused 0.6%

AWS Rekognition

Age 58-66
Gender Male, 97.7%
Calm 91.4%
Sad 2.6%
Confused 2.1%
Happy 1.7%
Angry 0.7%
Fear 0.6%
Surprised 0.5%
Disgusted 0.5%

AWS Rekognition

Age 22-30
Gender Female, 100%
Sad 94.7%
Calm 2.1%
Fear 1%
Confused 0.9%
Angry 0.4%
Disgusted 0.3%
Surprised 0.2%
Happy 0.2%

AWS Rekognition

Age 18-26
Gender Male, 99.4%
Calm 39.7%
Disgusted 26.3%
Happy 9.7%
Angry 6.1%
Fear 5.8%
Sad 4.8%
Confused 4.7%
Surprised 2.9%

Microsoft Cognitive Services

Age 56
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 96.8%
Tie 67.8%
Shoe 58.3%

Captions

Microsoft

a vintage photo of a man and a woman sitting in a room 87.8%
a vintage photo of some people in a room 87.7%
a vintage photo of a person sitting in a room 87.6%