Human Generated Data

Title

Untitled (President Nixon and family seated for portrait)
Date

c. 1970
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14121

Human Generated Data

Title

Untitled (President Nixon and family seated for portrait)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1970

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.3
Human 99.3
Person 99.2
Person 99.2
Person 97.9
People 97.7
Shoe 97.7
Footwear 97.7
Clothing 97.7
Apparel 97.7
Person 96
Family 95.4
Suit 83.7
Coat 83.7
Overcoat 83.7
Person 83.1
Shoe 81.6
Suit 78.2
Suit 76.5
Tuxedo 63
Shoe 58.3
Blazer 55.8
Jacket 55.8
Shoe 50

Imagga
created on 2022-01-22

man 47.1
male 40.7
businessman 38.9
people 34.1
smiling 34
professional 33.9
business 33.4
adult 33.1
businesswoman 31.8
happy 30.7
meeting 29.2
person 27.7
team 26.9
executive 26.7
group 26.6
men 25.8
businesspeople 25.6
colleagues 25.3
office 23.4
corporate 23.2
life 22.6
sitting 22.4
teamwork 22.3
smile 22.1
couple 21.8
standing 21.8
senior 21.6
kin 21.5
teacher 21.5
work 21.2
indoors 21.1
communication 18.5
suit 18.3
lifestyle 18.1
working 17.7
mature 17.7
father 17.7
home 17.6
women 17.4
30s 16.4
success 16.1
desk 16.1
job 15.9
cheerful 15.5
staff 15.3
manager 14.9
together 14.9
worker 14.8
coworkers 14.7
successful 14.7
workplace 14.3
mother 14.2
parent 14.2
educator 14.1
hospital 13.8
businessmen 13.7
confident 13.7
partners 13.6
portrait 13.6
indoor 12.8
40s 12.7
care 12.4
nurse 12.3
dad 12.2
table 12.1
occupation 11.9
holding 11.6
elderly 11.5
medical 11.5
talking 11.4
20s 11
friendly 11
happiness 11
child 10.9
secretary 10.9
discussing 10.8
diverse 10.8
well dressed 10.8
diversity 10.6
partnership 10.6
husband 10.5
company 10.2
room 10
family 9.8
looking camera 9.6
four 9.6
formal 9.6
color 9.5
doctor 9.4
presentation 9.3
health 9
handsome 8.9
associates 8.9
looking 8.8
student 8.8
grandfather 8.7
leadership 8.7
wife 8.5
career 8.5
two 8.5
attractive 8.4
inside 8.3
son 8.2
interior 8
face 7.8
discussion 7.8
cooperation 7.7
partner 7.7
boss 7.7
human 7.5
patient 7.5
school 7.5
camera 7.4
groom 7.3
computer 7.2
domestic 7
modern 7

Google
created on 2022-01-22

Trousers 96.6
Picture frame 96
Smile 93.6
Coat 88
Sleeve 86.8
Standing 86.4
Dress 85.7
Collar 82.1
Suit 81.6
Blazer 77.8
Family taking photos together 76.7
Formal wear 75.7
Art 74.7
Event 72.6
Vintage clothing 70.4
White-collar worker 69.4
High heels 66.9
Stock photography 65.8
Chair 65.6
Room 65.4

Microsoft
created on 2022-01-22

person 99.9
wall 99.8
suit 98.9
smile 98.5
clothing 98
indoor 96.8
woman 93.4
posing 89.7
human face 78.3
man 77.7
gallery 70.3
footwear 68.5
people 66.2
room 52.2
dressed 28
picture frame 23.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 20-28
Gender Male, 100%
Calm 45.7%
Happy 37.1%
Confused 7.2%
Angry 3.9%
Surprised 3.1%
Sad 1.4%
Fear 1%
Disgusted 0.7%

AWS Rekognition

Age 20-28
Gender Female, 99.9%
Happy 99.4%
Surprised 0.2%
Angry 0.1%
Confused 0.1%
Fear 0.1%
Disgusted 0.1%
Calm 0.1%
Sad 0%

AWS Rekognition

Age 27-37
Gender Male, 100%
Happy 99.8%
Angry 0%
Calm 0%
Fear 0%
Disgusted 0%
Surprised 0%
Confused 0%
Sad 0%

AWS Rekognition

Age 19-27
Gender Female, 100%
Happy 96.5%
Surprised 1.3%
Calm 0.6%
Fear 0.5%
Angry 0.4%
Confused 0.3%
Sad 0.2%
Disgusted 0.2%

AWS Rekognition

Age 50-58
Gender Male, 100%
Happy 98%
Confused 0.7%
Calm 0.4%
Angry 0.2%
Surprised 0.2%
Fear 0.2%
Disgusted 0.2%
Sad 0.1%

AWS Rekognition

Age 48-54
Gender Female, 100%
Happy 99.4%
Confused 0.2%
Surprised 0.2%
Angry 0.1%
Calm 0.1%
Disgusted 0.1%
Fear 0%
Sad 0%

Microsoft Cognitive Services

Age 48
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Shoe 97.7%
Suit 83.7%

Captions

Microsoft

David Eisenhower, Richard Nixon, Julie Nixon Eisenhower, Tricia Nixon Cox, Pat Nixon, Edward Cox posing for a photo 94.2%
David Eisenhower, Richard Nixon, Julie Nixon Eisenhower, Tricia Nixon Cox, Pat Nixon, Edward Cox posing for the camera 94.1%
David Eisenhower, Richard Nixon, Julie Nixon Eisenhower, Tricia Nixon Cox, Pat Nixon, Edward Cox sitting posing for the camera 93.7%