Human Generated Data

Title

Untitled (baby looking into man's shirt pocket)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17673

Human Generated Data

Title

Untitled (baby looking into man's shirt pocket)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Human 99.4
Person 99.4
Person 98.3
Face 92.2
Clothing 90.1
Apparel 90.1
Finger 89.3
Accessories 89
Tie 89
Accessory 89
Baby 78.9
People 59.1
Child 56.3
Kid 56.3
Sleeve 55.6
Newborn 55.1

Imagga
created on 2022-02-26

bow tie 62.7
necktie 51.7
love 41
family 36.5
happy 36.4
couple 35.7
child 35.6
male 33.1
mother 31.9
portrait 31.7
man 30.3
people 30.1
together 28.9
adult 28.5
person 27.4
senior 27.2
smile 27.1
parent 26.8
smiling 26.1
garment 26
husband 24.9
mature 24.2
relationship 22.5
lifestyle 22.4
kid 21.3
daughter 21.1
joy 20.9
grandma 20.3
wife 19.9
happiness 19.6
face 19.2
elderly 19.2
old 18.8
two 17.8
looking 17.6
fun 17.2
togetherness 17
affection 16.4
romantic 16
cute 15.8
clothing 15.6
groom 15.4
women 15
grandfather 14.8
baby 14.7
son 14.7
children 14.6
retired 14.6
hug 14.5
life 14.4
darling 13.8
pretty 13.3
home 12.8
casual 12.7
attractive 12.6
childhood 12.5
romance 12.5
little 12.4
care 12.3
boy 12.2
outdoors 11.9
playing 11.9
day 11.8
bonding 11.7
holding 11.6
park 11.5
married 11.5
cheerful 11.4
pensioner 10.9
caring 10.8
kiss 10.7
blond 10.7
lady 10.6
relaxed 10.3
men 10.3
friendship 10.3
handsome 9.8
brother 9.8
look 9.6
bride 9.6
loving 9.5
laughing 9.5
sitting 9.5
friends 9.4
joyful 9.2
outdoor 9.2
summer 9
human 9
grandmother 8.8
indoors 8.8
hugging 8.8
affectionate 8.7
infant 8.7
retirement 8.6
sibling 8.6
youth 8.5
modern 8.4
wedding 8.3
girls 8.2
dad 8.1
father 8.1
embracing 7.8
tenderness 7.8
older 7.8
play 7.8
boyfriend 7.7
girlfriend 7.7
generation 7.7
laugh 7.7
resting 7.6
marriage 7.6
enjoying 7.6
pair 7.6
leisure 7.5
adorable 7.4
relaxing 7.3
aged 7.2

Google
created on 2022-02-26

Photograph 94.2
White 92.2
Black 89.7
Smile 88.5
Flash photography 88.5
Happy 87
Black-and-white 86.8
Gesture 85.3
Style 84.1
Adaptation 79.2
Fun 76.5
Holding hands 76.3
Monochrome 76.3
Monochrome photography 75.8
Snapshot 74.3
T-shirt 72.3
Toddler 71.3
Blond 70.4
Event 69.6
Child 67.7

Microsoft
created on 2022-02-26

person 99.7
human face 96.7
clothing 91.8
text 84.7
smile 80.1
woman 75.6
dance 60.7
ceremony 56.1
wedding dress 50.9
crowd 0.5

Face analysis

Amazon

AWS Rekognition

Age 49-57
Gender Male, 68.9%
Calm 83.8%
Surprised 9.1%
Happy 3%
Sad 1.9%
Disgusted 0.8%
Fear 0.5%
Angry 0.5%
Confused 0.3%

AWS Rekognition

Age 42-50
Gender Female, 84.3%
Calm 92.1%
Surprised 6%
Fear 0.6%
Disgusted 0.4%
Confused 0.3%
Sad 0.3%
Angry 0.2%
Happy 0.1%

Feature analysis

Amazon

Person 99.4%
Tie 89%

Captions

Microsoft

a man and a woman looking at the camera 90.8%
a group of people looking at the camera 90.7%
a group of people looking at each other 90.6%

Text analysis

Amazon

17
SEC

Google

17 2VEE
2VEE
17