Human Generated Data

Title

Untitled (three men posed sitting in front of fireplace in living room)
Date

1943
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9968

Human Generated Data

Title

Untitled (three men posed sitting in front of fireplace in living room)

People

Artist: Martin Schweig, American 20th century

Date

1943

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9968

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Person 99
Human 99
Person 98.5
Clothing 97
Apparel 97
Person 96.6
Tie 88.8
Accessories 88.8
Accessory 88.8
Sitting 88.8
Suit 87.9
Overcoat 87.9
Coat 87.9
Person 79.5
Face 74.4
Long Sleeve 68.8
Sleeve 68.8
Sport 65.4
Sports 65.4
Pants 65.2
People 62.4
Cat 62.1
Animal 62.1
Mammal 62.1
Pet 62.1
Crowd 59.8
Female 55.2

Clarifai
created on 2023-10-27

people 99.9
group 97.3
man 96.4
adult 95.9
wear 95.1
group together 94.8
boxer 93.5
outfit 92.8
monochrome 92.6
three 91.7
gown (clothing) 91.4
leader 90.9
portrait 89.3
several 87.3
two 85.8
sit 85.1
four 84.5
position 84.4
actor 81.4
musician 79.8

Imagga
created on 2022-01-29

kin 53
man 29.6
people 27.9
male 23.4
couple 22.6
indoors 22
person 21.1
adult 20.7
senior 19.7
happy 16.9
grandfather 16.9
home 16.7
old 16.7
business 16.4
smiling 15.9
sitting 15.5
men 15.5
20s 14.7
colleagues 14.6
30s 14.4
businessman 14.1
together 14
mature 13.9
camera 13.9
mother 13.5
statue 13.5
businesspeople 13.3
cheerful 13
groom 12.9
women 12.6
portrait 12.3
meeting 12.2
friends 12.2
nurse 11.9
day 11.8
40s 11.7
religion 11.6
talking 11.4
architecture 10.9
businesswoman 10.9
team 10.7
family 10.7
medical 10.6
elderly 10.5
ancient 10.4
monument 10.3
happiness 10.2
casual 10.2
clothing 10
monk 9.9
history 9.8
room 9.7
group 9.7
four 9.6
god 9.6
love 9.5
color 9.5
friendship 9.4
two 9.3
drink 9.2
four people 8.9
70s 8.8
to 8.8
discussing 8.8
working 8.8
forties 8.8
casual clothing 8.8
two people 8.7
worker 8.6
metropolitan 8.6
drinking 8.6
professional 8.5
art 8.5
church 8.3
inside 8.3
tourism 8.2
office 8
hospital 8
patient 7.9
senior adult 7.9
business people 7.9
coworkers 7.9
60s 7.8
catholic 7.8
discussion 7.8
thirties 7.8
older 7.8
retired 7.8
marble 7.7
mid adult 7.7
retirement 7.7
bride 7.7
twenties 7.6
sculpture 7.6
husband 7.6
illness 7.6
enjoying 7.6
females 7.6
occupation 7.3
aged 7.2
lifestyle 7.2
face 7.1
restaurant 7.1

Google
created on 2022-01-29

Black 89.6
Snapshot 74.3
Monochrome photography 73.9
Monochrome 73.5
Vintage clothing 71.7
Monk 70.6
Classic 69.3
Event 68.5
Hat 67.6
Sitting 67
Art 66.8
Stock photography 64.3
History 64.2
Zen master 63.3
Room 57.8
Uniform 57.4
Photo caption 57.3
Team 57.2
Font 55
Photography 51.7

Microsoft
created on 2022-01-29

text 99
clothing 98.7
person 97.2
man 95.2
footwear 87.7
smile 83.8
player 60.8
human face 51.3
posing 51.1
old 43.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 100%
Calm 81.4%
Happy 15.9%
Surprised 1.7%
Disgusted 0.5%
Sad 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 27-37
Gender Male, 99.8%
Happy 80.8%
Calm 18%
Surprised 0.5%
Sad 0.2%
Disgusted 0.2%
Fear 0.1%
Angry 0.1%
Confused 0%

AWS Rekognition

Age 38-46
Gender Male, 83.6%
Calm 98.9%
Surprised 0.9%
Happy 0.1%
Sad 0%
Angry 0%
Disgusted 0%
Confused 0%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Cat
Person 99%
Person 98.5%
Person 96.6%
Person 79.5%
Tie 88.8%
Cat 62.1%

Categories

Imagga

paintings art 96.8%
interior objects 1.3%

Text analysis

Amazon

MJI3
MJI3 A7AA
A7AA
LPOS
the
10rre

Google

MJI7 YT3RA 2 A73A
MJI7
YT3RA
2
A73A