Human Generated Data

Title

Untitled (little boy and girl in matching outfits posing outside)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16540

Human Generated Data

Title

Untitled (little boy and girl in matching outfits posing outside)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-12

Clothing 99.8
Apparel 99.8
Person 99.5
Human 99.5
Person 99.4
Boy 98.2
Dress 98.2
Face 96.9
Kid 93.4
Child 93.4
Female 88.4
Smile 85.4
Girl 81.6
Photo 81.1
Portrait 81.1
Photography 81.1
Shoe 72.3
Footwear 72.3
Plant 71.3
Tree 71.3
Road 68
Costume 67
Baby 66.5
Pants 66.3
Building 62.3
City 62.3
Town 62.3
Street 62.3
Urban 62.3
Floor 61.4
Shorts 59.7
Door 59.6
Play 55.4

Imagga
created on 2022-02-12

stethoscope 54.2
child 42.5
male 31.9
sibling 31.6
medical instrument 30.4
person 29.7
people 28.4
man 28.2
instrument 26.5
adult 25.3
doctor 24.4
happy 23.8
portrait 22.6
medical 21.2
nurse 18.4
health 18.1
senior 17.8
smiling 17.4
smile 17.1
device 16.2
handsome 16
family 16
kid 15.9
happiness 15.7
boy 15.6
education 15.6
school 15.3
care 14.8
lifestyle 14.4
job 14.1
medicine 14.1
professional 13.6
hospital 13.5
mature 13
physician 12.7
illness 12.4
face 12.1
pretty 11.9
casual 11.9
childhood 11.6
cute 11.5
lady 11.4
attractive 11.2
hair 11.1
friendly 11
children 10.9
joy 10.9
bow tie 10.6
coat 10.6
little 10.6
clinic 10.5
together 10.5
men 10.3
love 10.3
youth 10.2
practitioner 9.9
parent 9.8
necktie 9.8
fun 9.7
mother 9.7
uniform 9.6
women 9.5
play 9.5
brother 9.5
kids 9.4
two 9.3
help 9.3
teen 9.2
playing 9.1
patient 9
looking 8.8
couple 8.7
sitting 8.6
expression 8.5
business 8.5
black 8.4
shirt 8.4
holding 8.2
indoor 8.2
one 8.2
teenager 8.2
cheerful 8.1
office 8
home 8
indoors 7.9
teacher 7.9
doctors 7.9
work 7.8
standing 7.8
elderly 7.7
tie 7.6
fashion 7.5
clothing 7.5
girls 7.3
student 7.2
success 7.2
son 7.1
daughter 7.1

Google
created on 2022-02-12

Outerwear 95.3
Vertebrate 91.9
Standing 86.4
Gesture 85.3
Black-and-white 84.8
Style 83.9
Toddler 80.8
Adaptation 79.2
Sleeve 78.6
Shorts 75.3
Vintage clothing 73.9
Monochrome photography 73.5
Monochrome 72.4
Smile 71.5
Art 70.7
Child 70.2
Uniform 65.4
Hat 64.2
Room 63.3
Stock photography 62.7

Microsoft
created on 2022-02-12

toddler 96.6
person 96.6
clothing 96
human face 95.2
black 93.8
boy 89.4
child 87.1
posing 86.8
baby 86.2
young 85.4
little 82.5
standing 79.2
smile 78.4
white 72.5
text 64.8
footwear 55.5

Face analysis

Amazon

Google

AWS Rekognition

Age 6-14
Gender Female, 97.8%
Calm 52.6%
Sad 31.1%
Fear 6.1%
Happy 4.6%
Angry 2.3%
Disgusted 1.6%
Surprised 0.9%
Confused 0.7%

AWS Rekognition

Age 1-7
Gender Female, 92.6%
Calm 97.1%
Happy 1%
Sad 0.9%
Disgusted 0.2%
Fear 0.2%
Surprised 0.2%
Angry 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%

Captions

Microsoft

a little girl posing for a photo 96.5%
a young boy standing next to a little girl posing for a photo 86.1%
a little boy and girl posing for a photo 85.4%

Text analysis

Amazon

8
7

Google

MI7--
-
37A°2
8.
MI7-- YT 37A°2 - - XAGON 8.
YT
XAGON