Human Generated Data

Title

Untitled (woman posed with three young sons on couch at Christmas gathering)
Date

1961
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9819

Human Generated Data

Title

Untitled (woman posed with three young sons on couch at Christmas gathering)

People

Artist: Martin Schweig, American 20th century

Date

1961

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9819

Machine Generated Data

Tags

Amazon
created on 2022-01-28

Clothing 99.8
Apparel 99.8
Person 99.3
Human 99.3
Person 98.9
Chair 98.2
Furniture 98.2
Person 95.9
Face 95.7
Head 88.1
Sleeve 87.8
Home Decor 84.9
Suit 83.2
Coat 83.2
Overcoat 83.2
Shirt 82.2
Text 78.7
Dress 77
Person 74.7
Portrait 74.5
Photography 74.5
Photo 74.5
Long Sleeve 73.7
Table 64.5
Sitting 64
Floor 63.1
Indoors 62.4
Glasses 62.3
Accessories 62.3
Accessory 62.3
Kid 62.3
Child 62.3
Door 60.2
Couch 59.1
Monitor 56.1
Electronics 56.1
Display 56.1
Screen 56.1
Man 56
Bed 55.7

Clarifai
created on 2023-10-27

people 99.8
group 99
man 98.6
adult 96.7
science 96.6
monochrome 96.5
child 94.1
three 93.9
education 91.6
woman 91.4
indoors 90.8
leader 90.6
group together 90.1
several 87.8
family 87.3
medicine 86.3
two 86.1
portrait 84.6
technology 83.8
healthcare 83.2

Imagga
created on 2022-01-28

people 32.9
person 31.2
man 26.9
nurse 26.1
adult 24.5
professional 20.1
patient 19.6
negative 19.5
male 17.8
kin 17.7
medical 17.6
worker 16.9
teacher 15.9
couple 15.7
film 15.3
smiling 15.2
happy 15
happiness 14.9
portrait 14.9
bride 14.4
work 14.2
human 14.2
health 13.9
women 13.4
team 13.4
doctor 13.1
senior 13.1
love 12.6
cheerful 12.2
men 12
home 12
clothing 11.9
photographic paper 11.9
family 11.6
educator 11.5
wedding 11
dress 10.8
medicine 10.6
lady 10.5
indoors 10.5
celebration 10.4
party 10.3
two 10.2
holiday 10
case 9.9
coat 9.8
mother 9.8
new 9.7
group 9.7
hospital 9.7
laboratory 9.6
clinic 9.3
teamwork 9.3
old 9
sick person 9
working 8.8
businessman 8.8
looking 8.8
lab 8.7
standing 8.7
bouquet 8.7
married 8.6
gift 8.6
smile 8.5
business 8.5
instrument 8.4
fashion 8.3
care 8.2
student 8.1
to 8
photographic equipment 7.9
husband 7.8
assistant 7.8
cap 7.8
sitting 7.7
test 7.7
casual 7.6
illness 7.6
marriage 7.6
groom 7.6
biology 7.6
room 7.5
child 7.5
decoration 7.3
year 7.3
world 7.3
color 7.2
black 7.2
romantic 7.1
science 7.1
kid 7.1
interior 7.1

Google
created on 2022-01-28

Gesture 85.3
Black-and-white 84.7
Style 83.8
Art 82.6
Font 80.8
Eyewear 80.3
Monochrome photography 71.8
Monochrome 71.1
Pattern 69.8
Visual arts 67.7
Fashion design 66.8
Vintage clothing 66.3
Room 66.1
Event 66
Stock photography 63.9
Sitting 62.1
Fun 56.7
Photographic paper 55.4
Chair 55.1
Paper product 51.2

Microsoft
created on 2022-01-28

text 99.3
clothing 96.8
person 94.3
man 93.7
human face 83.9
black and white 73.6
posing 72.9
smile 67.8

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 96.9%
Happy 99.1%
Fear 0.2%
Surprised 0.2%
Angry 0.1%
Sad 0.1%
Calm 0.1%
Disgusted 0.1%
Confused 0%

AWS Rekognition

Age 45-51
Gender Male, 98.2%
Happy 96.8%
Calm 1.2%
Surprised 0.9%
Disgusted 0.4%
Sad 0.3%
Confused 0.2%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 40-48
Gender Male, 96.1%
Calm 73.9%
Surprised 22%
Happy 1.1%
Angry 0.8%
Fear 0.7%
Disgusted 0.6%
Sad 0.5%
Confused 0.3%

AWS Rekognition

Age 29-39
Gender Male, 72.6%
Happy 41.5%
Calm 29.4%
Surprised 13.4%
Sad 5.9%
Fear 4.5%
Disgusted 2.7%
Angry 1.7%
Confused 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Couch
Person 99.3%
Person 98.9%
Person 95.9%
Person 74.7%
Couch 59.1%

Text analysis

Amazon

KODAK-A-EITW

Google

2 2 3 3 S MJI7--YT37A°2 - - XAGON
2
3
S
MJI7--YT37A°2
-
XAGON