Human Generated Data

Title

Untitled (four smiling girls and baby, all in a line)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16423

Human Generated Data

Title

Untitled (four smiling girls and baby, all in a line)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-11

Clothing 99.2
Apparel 99.2
Human 99.1
Person 99.1
Person 98.8
Person 98.1
Shorts 96.8
Person 95.7
Person 94.6
Shoe 85.8
Footwear 85.8
Female 84.9
People 76.2
Girl 75.7
Face 72.1
Chair 65.2
Furniture 65.2
Leisure Activities 64.4
Photo 64.1
Portrait 64.1
Photography 64.1
Dance Pose 61.1
Shoe 59.5
Child 58.8
Kid 58.8
Shoe 53.5

Imagga
created on 2022-02-11

silhouette 39.7
people 35.7
crowd 32.6
audience 31.2
person 30.7
sport 30.6
player 30.6
nation 30.3
stadium 30.1
patriotic 29.7
event 29.6
flag 28.4
lights 27.8
athlete 27.6
symbol 27.6
cheering 27.4
muscular 26.7
skill 26
training 25.9
championship 25.3
match 25.1
team 25.1
reflection 24.8
competition 24.7
nighttime 24.5
field 22.6
icon 21.4
creation 21.3
man 20.8
picture 20.2
male 19.9
art 19
representation 18
ball 17.6
vibrant 17.5
park 17.3
bright 17.1
design 16.9
dance 16.8
versus 16.7
shoot 15.5
glowing 14.8
soccer 14.4
goal 14.4
shiny 14.2
group 13.7
kick 13.7
pass 13.6
teamwork 12
shorts 11.7
world 11.7
football 11.5
business 10.3
vivid 10.2
negative 10.1
global 10
fight 9.7
dangerous 9.5
ice 9.1
adult 9.1
science 8.9
film 8.9
court 8.8
couple 8.7
youth 8.5
against 8.3
human 8.2
star 8.1
businessman 7.9
uppercut 7.9
jab 7.9
women 7.9
ropes 7.9
punch 7.9
block 7.8
boxing 7.8
gloves 7.8
men 7.7
drawing 7.7
grunge 7.7
sibling 7.6
ring 7.5
fashion 7.5
lifestyle 7.2
sexy 7.2
music 7.2
work 7.2
modern 7

Google
created on 2022-02-11

Smile 97
Style 83.9
Black-and-white 83.6
Font 75.7
Dance 74.6
Art 74.3
Happy 73.1
Event 73.1
Monochrome photography 72.3
Entertainment 70.5
Monochrome 70.4
Vintage clothing 69.3
Room 66.9
Performing arts 66.2
Fun 65.8
Team 63.6
Pattern 61.4
Child 59.3
Visual arts 56.4
Crew 54.6

Microsoft
created on 2022-02-11

text 93.1
person 91.3
posing 88.3
clothing 87.2
footwear 81.6
smile 67.6
human face 64.7
old 40.8

Face analysis

Amazon

Google

AWS Rekognition

Age 36-44
Gender Female, 99.3%
Happy 80.9%
Calm 9.4%
Surprised 3.9%
Sad 3.2%
Confused 1%
Fear 0.7%
Angry 0.6%
Disgusted 0.4%

AWS Rekognition

Age 28-38
Gender Male, 99.7%
Surprised 51.8%
Calm 21%
Confused 12.9%
Sad 4.7%
Disgusted 4.1%
Happy 2%
Fear 1.9%
Angry 1.6%

AWS Rekognition

Age 24-34
Gender Male, 98.5%
Surprised 94.1%
Happy 3.9%
Calm 1.5%
Sad 0.2%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 34-42
Gender Male, 82.4%
Happy 97.4%
Sad 0.6%
Surprised 0.6%
Disgusted 0.5%
Calm 0.4%
Fear 0.2%
Confused 0.1%
Angry 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.1%
Shoe 85.8%

Captions

Microsoft

a group of people posing for a photo 89.5%
a group of people posing for the camera 89.4%
a group of people posing for a picture 89.3%

Text analysis

Amazon

24
MJI7
MJI7 YT37A'S KAGOK
YT37A'S
KAGOK

Google

24
24