Human Generated Data

Title

Untitled (seven employees posing inside produce department)

Date

c. 1950

People

Artist: Jack Rodden Studio, American 1914 - 2016

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13510

Human Generated Data

Title

Untitled (seven employees posing inside produce department)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Person 99.7
Human 99.7
Person 99.5
Person 99.4
Person 99.1
Person 98.7
Person 94.5
Person 94.1
Clothing 90.9
Shorts 90.9
Apparel 90.9
Shop 80.4
People 76.3
Food 56.9
Indoors 56.5

Imagga
created on 2022-02-04

crowd 75.8
stadium 70.5
audience 70.2
nation 68.2
patriotic 68.1
silhouette 66.2
flag 66.2
lights 64.9
cheering 59.8
nighttime 56.8
icon 53.8
vibrant 52.5
championship 50.6
match 50.2
event 49.9
athlete 49.8
muscular 49.7
skill 49.1
competition 48.5
symbol 48.5
training 47.1
sport 45.1
vivid 42.7
people 41.8
bright 40
person 40
player 38.1
design 37.7
glowing 36
field 32.6
versus 31.5
team 31.4
shiny 27.7
shoot 26.1
soccer 25
goal 25
pass 24.3
kick 23.4
world 23.3
ball 23.2
group 21.8
park 21.4
football 21.1
playing 19.1
male 19.1
man 18.8
fight 17.4
dangerous 17.1
bass 16.1
classroom 15.9
music 15.3
sword 14.8
concert 14.6
room 14.2
weapon 14
guitar 13.9
teamwork 13.9
stab 13.8
fencing 13.8
technique 13.8
band 13.7
protection 13.6
blade 13.6
pop 13.6
gear 13.5
musical 13.4
sharp 13.3
musician 13.3
electric 13.1
blues 12.8
instruments 12.8
acoustic 12.8
jazz 12.8
shorts 12.7
insignia 12.7
live 12.7
court 12.7
practice 12.6
performance 12.4
classical 12.4
button 12.3
business 10.9
global 10
television 9.9
drums 9.9
curve 9.6
teacher 9.6
round 9.5
center 9.2
backhand 8.9
fans 8.9
job 8.8
racket 8.8
serve 8.8
tennis 8.8
occupation 8.2
star 8.2
educator 7.9
cross 7.5
city 7.5
businesswoman 7.3
work 7.1
businessman 7.1

Google
created on 2022-02-04

Microsoft
created on 2022-02-04

text 97.8
person 92.6
clothing 91.5
man 80.4
black and white 66

Face analysis

Amazon

Google

AWS Rekognition

Age 31-41
Gender Male, 98.1%
Sad 51%
Happy 30.9%
Angry 6.4%
Calm 4.6%
Confused 4.2%
Disgusted 1.8%
Surprised 0.7%
Fear 0.5%

AWS Rekognition

Age 48-56
Gender Male, 96.8%
Sad 78.4%
Happy 15%
Calm 2.5%
Confused 1.3%
Disgusted 0.8%
Angry 0.8%
Fear 0.5%
Surprised 0.5%

AWS Rekognition

Age 45-53
Gender Male, 95.6%
Calm 79.8%
Happy 12.8%
Sad 4%
Confused 1.7%
Angry 0.6%
Surprised 0.4%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 25-35
Gender Female, 98%
Calm 62.5%
Happy 26.6%
Sad 9.7%
Fear 0.3%
Confused 0.3%
Surprised 0.2%
Disgusted 0.1%
Angry 0.1%

AWS Rekognition

Age 45-53
Gender Male, 92%
Confused 39.3%
Calm 35.1%
Disgusted 8%
Surprised 7.5%
Happy 3.7%
Sad 2.7%
Angry 2%
Fear 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a group of people riding on the back of a horse 75.9%
a group of people standing in front of a horse 75.8%
a group of people standing next to a horse 75.7%

Text analysis

Amazon

EVERY
DAY
FRESHNESS
You'll
PRIZE
FIRST
rapes
A
not
CE
A BREAK
la CE
JERE
25
FRESH JERE
FRESH
DE
VARRY
BAIDES
la
BREAK

Google

EVERY
FIRST
FRESHNESS EVERY DAY EVERY DAY Youl FIRST PRIZE rOES
FRESHNESS
DAY
Youl
PRIZE
rOES