Human Generated Data

Title

Untitled (man holding baby)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17106

Human Generated Data

Title

Untitled (man holding baby)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Clothing 99.9
Apparel 99.9
Human 99.1
Person 99.1
Person 96.1
Gown 89.8
Fashion 89.8
Robe 88.3
Overcoat 87.6
Suit 87.6
Coat 87.6
Face 85.4
Wedding 82.5
Female 82
Sleeve 78.5
Shirt 76.3
Wedding Gown 73.4
Long Sleeve 72.5
Woman 71.9
Photo 67.9
Photography 67.9
Portrait 67.9
Finger 63.2
Handrail 60.7
Banister 60.7
Bride 59
Tuxedo 58.5
Bridegroom 57.6

Imagga
created on 2022-02-26

lab coat 60.2
coat 52.3
man 40.3
male 35.5
person 35
people 34
senior 32.8
nurse 31.4
adult 30.6
patient 29.1
couple 27.9
doctor 26.3
elderly 24.9
happy 24.4
medical 23.8
garment 23.6
professional 22.7
mature 22.3
portrait 21.4
hospital 21.3
health 20.8
groom 19.5
indoors 18.5
smiling 18.1
men 18
specialist 17.8
job 16.8
looking 16.8
clothing 16.7
occupation 16.5
happiness 16.5
old 16
medicine 15.9
holding 15.7
care 15.6
sitting 15.5
clinic 15.5
businessman 15
surgeon 14.7
lifestyle 14.5
casual 14.4
smile 14.3
face 14.2
love 14.2
human 13.5
married 13.4
handsome 13.4
stethoscope 13.3
worker 12.8
suit 12.7
women 12.7
illness 12.4
camera 12
indoor 11.9
family 11.6
business 11.5
uniform 11.5
office 11.2
two 11
day 11
bride 10.9
team 10.8
older 10.7
retired 10.7
retirement 10.6
profession 10.5
together 10.5
husband 10.5
wife 10.4
bright 10
working 9.7
sick person 9.7
case 9.5
color 9.5
wedding 9.2
hand 9.1
aged 9.1
cheerful 8.9
home 8.8
middle aged 8.8
two people 8.8
assistant 8.7
colleagues 8.7
standing 8.7
mid adult 8.7
30s 8.7
businesspeople 8.5
attractive 8.4
student 8.2
room 8.2
confident 8.2
hair 7.9
gray hair 7.9
work 7.9
physician 7.8
expertise 7.8
corporate 7.7
laboratory 7.7
staff 7.7
age 7.6
marriage 7.6
career 7.6
teamwork 7.4
treatment 7.3
executive 7.3
20s 7.3
successful 7.3
life 7.2
to 7.1
bow tie 7.1
equipment 7
look 7

Google
created on 2022-02-26

Flash photography 85.8
Gesture 85.3
Black-and-white 84.4
Style 83.9
Font 82.6
Tie 82
Microphone 79.6
Audio equipment 79.4
Monochrome photography 73.9
Electronic device 73.3
White-collar worker 73
Event 72.4
Display device 71.9
Monochrome 70.1
Formal wear 68.3
Presentation 67.3
Speech 66.4
Room 66.2
Suit 62.8
Stock photography 62.8

Microsoft
created on 2022-02-26

text 98.5
wall 98.3
person 97.7
human face 94.4
clothing 79.3
standing 77.2
man 61.4

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 98.5%
Calm 91.3%
Surprised 6%
Angry 0.9%
Disgusted 0.4%
Confused 0.4%
Fear 0.4%
Happy 0.3%
Sad 0.3%

AWS Rekognition

Age 7-17
Gender Female, 87.3%
Surprised 86.6%
Calm 5.8%
Happy 4.4%
Fear 2.2%
Disgusted 0.4%
Angry 0.3%
Sad 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%

Captions

Microsoft

a person standing in front of a mirror posing for the camera 70.1%
a person that is standing in front of a mirror posing for the camera 58.8%
a person standing in front of a mirror 58.7%

Text analysis

Amazon

NAGGA
YT3RAO NAGGA
YT3RAO