Human Generated Data

Title

Untitled (man holding child on shoulders)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16859

Human Generated Data

Title

Untitled (man holding child on shoulders)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16859

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Face 98.7
Human 98.7
Clothing 98.6
Apparel 98.6
Person 98.1
Tie 97.1
Accessories 97.1
Accessory 97.1
Person 92.4
Smile 90.7
Female 90.4
Girl 78.2
Portrait 76.7
Photography 76.7
Photo 76.7
Kid 74.8
Child 74.8
Finger 68.3
People 65.9
Coat 58.4
Door 57.6
Boy 56.1
Woman 55.9
Shirt 55.4

Clarifai
created on 2023-10-29

people 99.5
portrait 98.4
one 97.7
retro 97.5
wear 96.3
movie 94.3
child 94.1
music 93.3
facial expression 93.2
adult 92.8
comedy 91.7
actress 90.6
amusing 89.8
son 89.8
outfit 88.4
musician 87
nostalgia 86.6
humor 86.4
fashion 85.9
man 84.4

Imagga
created on 2022-02-26

man 37
person 36.4
male 31.8
lab coat 29.2
senior 29.1
people 27.9
portrait 27.8
adult 26.7
coat 26
happy 24.4
smiling 21
couple 20.9
elderly 20.1
face 19.9
smile 19.2
doctor 18.8
bow tie 18
medical 17.7
patient 17.6
looking 16.8
garment 16.3
hospital 16.1
husband 15.4
attractive 15.4
love 15
grandfather 15
mature 14.9
professional 14.8
necktie 14.5
hair 14.3
clothing 14.2
brother 14.1
pretty 14
care 14
affection 13.5
married 13.4
handsome 13.4
wife 13.3
together 13.1
lifestyle 13
office 12.9
women 12.7
old 12.5
glasses 12
world 11.9
grandma 11.8
exam 11.5
medicine 11.4
indoors 11.4
lady 11.4
eyes 11.2
men 11.2
health 11.1
expression 11.1
occupation 11
family 10.7
busy 10.6
businessman 10.6
business 10.3
sitting 10.3
bright 10
father 9.9
fun 9.7
lab 9.7
look 9.6
clinic 9.6
illness 9.5
enjoying 9.5
happiness 9.4
mother 9.4
child 9.3
holding 9.1
aged 9
black 9
science 8.9
healthy 8.8
worker 8.8
retired 8.7
laboratory 8.7
retirement 8.6
work 8.6
cute 8.6
loving 8.6
stethoscope 8.5
confident 8.2
gray 8.1
job 8
gown 7.9
blond 7.8
affectionate 7.7
sibling 7.7
profession 7.7
marriage 7.6
tie 7.6
suit 7.4
treatment 7.3
cheerful 7.3
indoor 7.3
color 7.2
sexy 7.2
lovely 7.1
day 7.1

Google
created on 2022-02-26

Smile 94.2
Photograph 94.2
Gesture 85.3
Black-and-white 84.1
Style 83.9
Happy 79.9
Art 76.8
Monochrome photography 75.6
Snapshot 74.3
Monochrome 74
Toddler 73.2
Font 71.9
Vintage clothing 69.8
Pattern 65.8
Photo caption 65.3
Stock photography 63.4
Visual arts 60
Illustration 58.6
Portrait 58
Room 57.7

Microsoft
created on 2022-02-26

human face 98.4
text 97
smile 96.4
person 95
clothing 93.2
toddler 61.6
posing 40.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 52-60
Gender Male, 99.9%
Happy 64.1%
Sad 23.7%
Confused 4%
Disgusted 2.2%
Calm 1.9%
Fear 1.5%
Angry 1.3%
Surprised 1.2%

AWS Rekognition

Age 21-29
Gender Female, 97.9%
Happy 50.3%
Angry 27.1%
Fear 13.7%
Surprised 3.3%
Sad 2.6%
Disgusted 1.4%
Calm 1.1%
Confused 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Tie
Person 98.1%
Person 92.4%
Tie 97.1%

Categories

Imagga

paintings art 99.8%

Captions

Microsoft
created on 2022-02-26

a person posing for the camera 91.8%
a boy posing for a photo 64.8%
a boy wearing a suit and tie 64.7%

Text analysis

Amazon

25
513
Sr.
y
Y
MJ17--YT37A°S--X
SEX
242
SIZ
533
515
S
3r.

Google

MJI7-- Y T 3RA°2-- AGO 25
MJI7--
Y
T
3RA°2--
AGO
25