Human Generated Data

Title

Untitled (three men posed sitting in front of fireplace in living room)

Date

1943

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9968

Human Generated Data

Title

Untitled (three men posed sitting in front of fireplace in living room)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99
Human 99
Person 98.5
Clothing 97
Apparel 97
Person 96.6
Accessories 88.8
Tie 88.8
Accessory 88.8
Sitting 88.8
Suit 87.9
Coat 87.9
Overcoat 87.9
Person 79.5
Face 74.4
Long Sleeve 68.8
Sleeve 68.8
Sport 65.4
Sports 65.4
Pants 65.2
People 62.4
Pet 62.1
Mammal 62.1
Cat 62.1
Animal 62.1
Crowd 59.8
Female 55.2

Imagga
created on 2022-01-29

kin 53
man 29.6
people 27.9
male 23.4
couple 22.6
indoors 22
person 21.1
adult 20.7
senior 19.7
happy 16.9
grandfather 16.9
home 16.7
old 16.7
business 16.4
smiling 15.9
sitting 15.5
men 15.5
20s 14.7
colleagues 14.6
30s 14.4
businessman 14.1
together 14
mature 13.9
camera 13.9
mother 13.5
statue 13.5
businesspeople 13.3
cheerful 13
groom 12.9
women 12.6
portrait 12.3
meeting 12.2
friends 12.2
nurse 11.9
day 11.8
40s 11.7
religion 11.6
talking 11.4
architecture 10.9
businesswoman 10.9
team 10.7
family 10.7
medical 10.6
elderly 10.5
ancient 10.4
monument 10.3
happiness 10.2
casual 10.2
clothing 10
monk 9.9
history 9.8
room 9.7
group 9.7
four 9.6
god 9.6
love 9.5
color 9.5
friendship 9.4
two 9.3
drink 9.2
four people 8.9
70s 8.8
to 8.8
discussing 8.8
working 8.8
forties 8.8
casual clothing 8.8
two people 8.7
worker 8.6
metropolitan 8.6
drinking 8.6
professional 8.5
art 8.5
church 8.3
inside 8.3
tourism 8.2
office 8
hospital 8
patient 7.9
senior adult 7.9
business people 7.9
coworkers 7.9
60s 7.8
catholic 7.8
discussion 7.8
thirties 7.8
older 7.8
retired 7.8
marble 7.7
mid adult 7.7
retirement 7.7
bride 7.7
twenties 7.6
sculpture 7.6
husband 7.6
illness 7.6
enjoying 7.6
females 7.6
occupation 7.3
aged 7.2
lifestyle 7.2
face 7.1
restaurant 7.1

Google
created on 2022-01-29

Black 89.6
Snapshot 74.3
Monochrome photography 73.9
Monochrome 73.5
Vintage clothing 71.7
Monk 70.6
Classic 69.3
Event 68.5
Hat 67.6
Sitting 67
Art 66.8
Stock photography 64.3
History 64.2
Zen master 63.3
Room 57.8
Uniform 57.4
Photo caption 57.3
Team 57.2
Font 55
Photography 51.7

Microsoft
created on 2022-01-29

text 99
clothing 98.7
person 97.2
man 95.2
footwear 87.7
smile 83.8
player 60.8
human face 51.3
posing 51.1
old 43.3

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 81.4%
Happy 15.9%
Surprised 1.7%
Disgusted 0.5%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Happy 80.8%
Calm 18%
Surprised 0.5%
Sad 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 38-46
Gender Male, 83.6%
Calm 98.9%
Surprised 0.9%
Happy 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 88.8%
Cat 62.1%

Captions

Microsoft

a group of people posing for a photo 94.7%
a group of people posing for the camera 94.6%
a group of people posing for a picture 94.5%

Text analysis

Amazon

MJI3
MJI3 A7AA
A7AA
LPOS
the
10rre

Google

MJI7
2
MJI7 YT3RA 2 A73A
A73A
YT3RA