Human Generated Data

Title

Untitled (studio portrait of parents posed with two daughters)

Date

1952

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9990

Human Generated Data

Title

Untitled (studio portrait of parents posed with two daughters)

People

Artist: Martin Schweig, American 20th century

Date

1952

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-29

Clothing 99.8
Apparel 99.8
Person 99.3
Human 99.3
Person 98.6
Person 97.8
Person 97.5
Coat 92.4
Overcoat 72.7
People 70.2
Suit 70
Clinic 66.7
Doctor 58

Imagga
created on 2022-01-29

nurse 75.2
negative 38.7
people 36.8
man 33.6
person 32.4
film 30.5
doctor 27.2
adult 26.9
medical 25.6
male 25.5
photographic paper 23.6
patient 22.9
couple 22.6
professional 21.9
health 20.1
portrait 20
worker 19.6
medicine 19.4
clinic 18.2
hospital 17.8
coat 17.8
human 17.2
happy 16.9
senior 16.9
working 16.8
smiling 16.6
work 16.5
clothing 16.4
laboratory 16.4
team 16.1
photographic equipment 15.7
men 15.4
lab 14.6
business 14.6
home 14.3
women 14.2
love 14.2
businessman 14.1
happiness 14.1
test 13.5
illness 13.3
science 13.3
surgeon 12.8
occupation 12.8
two 12.7
husband 12.4
research 12.4
biology 12.3
indoors 12.3
shower cap 12.3
casual 11.9
scientist 11.7
lab coat 11.7
chemical 11.7
scientific 11.6
chemistry 11.6
equipment 11.4
together 11.4
wife 11.4
attractive 11.2
20s 11
student 11
chemist 10.8
suit 10.8
biotechnology 10.8
family 10.7
cap 10.6
bride 10.5
elderly 10.5
development 10.5
looking 10.4
technology 10.4
sitting 10.3
kin 10.2
teamwork 10.2
groom 10.2
lifestyle 10.1
smile 10
care 9.9
researcher 9.9
technician 9.8
job 9.7
assistant 9.7
colleagues 9.7
education 9.5
mature 9.3
camera 9.2
old 9
biochemistry 8.9
microscope 8.9
microbiology 8.9
look 8.8
two people 8.7
optical 8.7
uniform 8.7
married 8.6
face 8.5
instrument 8.4
wedding 8.3
group 8.1
office 8
handsome 8
observation 7.9
70s 7.9
day 7.8
surgery 7.8
color 7.8
30s 7.7
businesspeople 7.6
house 7.5
joy 7.5
headdress 7.5
cheerful 7.3
lady 7.3
indoor 7.3
mother 7.2

Google
created on 2022-01-29

Coat 88.3
Sleeve 87.2
Black-and-white 85.1
Style 84
Smile 82.9
Font 80.1
Eyewear 79.3
Curtain 74.5
Monochrome photography 74.4
Event 74
Monochrome 73.5
Vintage clothing 72
Art 71.5
Fashion design 68.2
Fun 68.1
Stock photography 63.5
T-shirt 63.1
Team 61.1
Room 58.6
Visual arts 58.1

Microsoft
created on 2022-01-29

person 97.8
smile 91.2
human face 90.4
clothing 88.6
text 88.5
wedding dress 88.1
ceremony 87.8
posing 85.3
window 82.9
bride 82.1
man 70
people 58.3
dress 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 86.9%
Happy 67.4%
Surprised 10%
Calm 8.2%
Fear 6.3%
Sad 4.6%
Angry 1.6%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 95.7%
Surprised 1.7%
Sad 1.3%
Happy 0.5%
Confused 0.4%
Angry 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Female, 99.6%
Surprised 68.5%
Calm 12.2%
Happy 8.1%
Fear 3.1%
Confused 3%
Disgusted 2.1%
Angry 1.7%
Sad 1.3%

AWS Rekognition

Age 12-20
Gender Female, 99.7%
Sad 83.7%
Calm 13.5%
Happy 0.8%
Confused 0.6%
Surprised 0.4%
Angry 0.4%
Disgusted 0.3%
Fear 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Suit 70%

Captions

Microsoft

a group of people posing for a photo 97.6%
a group of people posing for the camera 97.5%
a group of people posing for a picture 97.4%

Text analysis

Amazon

st
٢a٤