Human Generated Data

Title

Untitled (children wearing shirts with their names sewn on)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17371

Human Generated Data

Title

Untitled (children wearing shirts with their names sewn on)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.6
Human 99.6
Person 99.4
Person 99.4
Face 99.1
Apparel 98.8
Clothing 98.8
Person 98.7
Boy 98
Furniture 91
Smile 89.6
Couch 84.8
Chair 82.6
Accessory 80.6
Glasses 80.6
Accessories 80.6
Baby 79.9
Child 79.7
Kid 79.7
Shorts 78.3
Bed 77.3
Indoors 75.2
Photography 74.7
Portrait 74.7
Photo 74.7
Sleeve 69
Head 68.8
Door 68.3
People 65.8
Room 62.8
Bedroom 62.8
Man 60.9
Lip 57.9
Teeth 57.9
Mouth 57.9
Shirt 56.9

Imagga
created on 2022-02-26

man 38.9
person 36
people 34
male 29.9
couple 25.2
kin 24.4
adult 24.2
home 23.1
smiling 21.7
senior 21.5
room 20
men 19.7
patient 19.4
happy 18.8
family 16.9
child 16
teacher 16
together 15.8
happiness 15.7
nurse 15.2
indoors 14.9
portrait 14.2
student 13.9
world 13.8
sitting 13.7
husband 13.5
group 12.9
professional 12.8
smile 12.8
two 12.7
elderly 12.4
businessman 12.3
grandfather 12.1
education 12.1
mother 11.6
business 11.5
wife 11.4
mature 11.1
women 11.1
love 11
school 10.9
cheerful 10.6
old 10.4
classroom 10.4
meeting 10.4
father 10.2
lifestyle 10.1
hospital 10
team 9.8
sibling 9.7
medical 9.7
sick person 9.6
30s 9.6
retirement 9.6
boy 9.6
case 9.4
daughter 9.4
blackboard 9.2
health 9
black 9
human 9
success 8.8
70s 8.8
office 8.8
teaching 8.8
table 8.6
youth 8.5
teamwork 8.3
camera 8.3
inside 8.3
holding 8.2
care 8.2
suit 8.1
looking 8
kid 8
thirties 7.8
two people 7.8
mid adult 7.7
married 7.7
casual 7.6
talking 7.6
hand 7.6
businesswoman 7.3
job 7.1
interior 7.1
working 7.1

Google
created on 2022-02-26

Black 89.6
Style 83.9
Black-and-white 83.5
Font 79.3
Curtain 78.8
Toddler 77
Monochrome photography 71.3
Monochrome 69.8
Event 69.8
Room 68.6
T-shirt 68.4
Baby 66.8
Child 64.3
Sitting 63.1
Stock photography 61.8
Rectangle 61.7
Happy 60.4
Visual arts 59.5
Blackboard 56.2
Fun 56.1

Microsoft
created on 2022-02-26

toddler 97.1
clothing 94.1
baby 93.6
person 93.4
text 91.3
human face 89.5
posing 87
boy 84.3

Face analysis

Amazon

Google

AWS Rekognition

Age 22-30
Gender Male, 54.4%
Surprised 97.7%
Calm 1.6%
Happy 0.3%
Fear 0.2%
Angry 0.1%
Disgusted 0.1%
Sad 0%
Confused 0%

AWS Rekognition

Age 34-42
Gender Male, 99.3%
Happy 90%
Calm 4.1%
Sad 2.5%
Surprised 1.8%
Fear 0.6%
Angry 0.5%
Confused 0.3%
Disgusted 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Couch 84.8%

Captions

Microsoft

a group of people posing for a photo 93.3%
a group of people sitting posing for the camera 93.2%
a group of people posing for the camera 93.1%

Text analysis

Amazon

Harriet
27
Katharine
Wilkes
Elizaboth
KODAK
KODAK SPEEDX
SPEEDX

Google

27
Hfarriet
W.lkas
27 Hfarriet W.lkas Katharine
Katharine