Human Generated Data

Title

Untitled (kids eating batter from bowl, boy crying)
Date

c. 1950
People

Artist: Lucian and Mary Brown, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16348

Human Generated Data

Title

Untitled (kids eating batter from bowl, boy crying)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Person 99.2
Human 99.2
Clothing 98
Apparel 98
Person 97.3
Blonde 97.1
Female 97.1
Girl 97.1
Kid 97.1
Woman 97.1
Teen 97.1
Child 97.1
Interior Design 96.5
Indoors 96.5
Dress 96.5
Floor 94.6
Furniture 93.8
Chair 93.8
Play 89.4
Plant 88.5
Room 86.5
Face 80.1
Suit 79.4
Coat 79.4
Overcoat 79.4
Person 75.5
People 72.9
Person 72.3
Shorts 71.8
Meal 71.8
Food 71.8
Table 68
Portrait 67.8
Photo 67.8
Photography 67.8
Flooring 63.8
Blossom 63.1
Flower 63.1
Grass 62.3
Baby 56.6
Hair 55.3

Imagga
created on 2022-02-11

teacher 35.4
person 33.3
adult 28.9
man 26.9
people 26.2
dress 26.2
educator 25.1
dancer 24.3
bride 23.4
love 22.1
wedding 21.1
groom 21.1
fashion 21.1
male 19.9
professional 19.5
couple 19.2
sport 18.6
performer 17.1
happy 16.9
happiness 16.4
lifestyle 15.9
style 14.8
dance 14.5
black 14.5
married 14.4
active 14.2
attractive 13.3
model 13.2
clothing 13.2
action 13
world 13
portrait 12.9
fun 12.7
gown 12.7
ball 12.6
elegance 12.6
bouquet 12.5
player 12.3
marriage 12.3
studio 12.2
men 12
youth 11.9
exercise 11.8
outdoor 11.5
face 11.4
one 11.2
women 11.1
two 11
fitness 10.8
entertainer 10.6
human 10.5
outdoors 10.4
summer 10.3
pose 10
activity 9.8
modern 9.8
posing 9.8
body 9.6
play 9.5
motion 9.4
athlete 9.4
expression 9.4
child 9.4
clothes 9.4
smile 9.3
hair 8.7
standing 8.7
smiling 8.7
dancing 8.7
outside 8.6
wife 8.5
event 8.3
leisure 8.3
art 8.3
holding 8.2
stylish 8.1
cheerful 8.1
lady 8.1
game 8
together 7.9
wed 7.9
veil 7.8
pretty 7.7
flower 7.7
hand 7.6
joy 7.5
sword 7.5
costume 7.4
girls 7.3
blond 7.2
sexy 7.2
planner 7.1
businessman 7.1

Google
created on 2022-02-11

Shorts 92.1
Black 89.6
Flash photography 86.8
Black-and-white 85.7
Gesture 85.3
Style 84
Font 77.3
Happy 75.8
Monochrome 75.3
Monochrome photography 75.3
Snapshot 74.3
Ball 73.8
Room 67.7
Stock photography 65.2
Sitting 62
Still life photography 61.7
T-shirt 60.5
Glass 60.2
Fun 59.7
Visual arts 59.4

Microsoft
created on 2022-02-11

cartoon 92.3
person 91.3
text 91
window 89.5
drawing 79.5
clothing 62.4

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Female, 99.6%
Sad 87.1%
Happy 7.6%
Calm 2.6%
Fear 0.8%
Angry 0.7%
Surprised 0.7%
Disgusted 0.5%
Confused 0.2%

AWS Rekognition

Age 6-14
Gender Male, 60.6%
Calm 95.9%
Sad 2.3%
Surprised 1.3%
Disgusted 0.2%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Female, 79.4%
Surprised 68.2%
Happy 11.9%
Angry 6.8%
Calm 5.5%
Fear 4.8%
Disgusted 1.1%
Sad 0.9%
Confused 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%

Captions

Microsoft

a man and a woman standing in front of a window 46.2%
a person standing next to a window 46.1%
a man and woman posing for a photo in front of a window 35.9%

Text analysis

Amazon

28

Google

28
28