Human Generated Data

Title

Untitled (nineteen employees posing inside produce department)

Date

c. 1950

People

Artist: Jack Rodden Studio, American 1914 - 2016

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13509

Human Generated Data

Title

Untitled (nineteen employees posing inside produce department)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Person 99.4
Human 99.4
Person 99.2
Person 98.2
Shorts 98.1
Apparel 98.1
Clothing 98.1
Person 96
Person 94.6
Person 93.2
Person 89.7
People 82.2
Pedestrian 81.6
Person 81.5
Face 81.3
Person 81.3
Person 69.4
Person 68.6
Meal 66.8
Food 66.8
Crowd 64.3
Accessories 62.6
Accessory 62.6
Tie 62.6
Flooring 62.3
Person 60.4
Suit 58.9
Overcoat 58.9
Coat 58.9
Field 58
Electronics 57.8
Screen 57.8
Display 57
Monitor 57
Female 55.4
Floor 55.4

Imagga
created on 2022-02-04

classroom 73.8
room 57.3
person 48.6
crowd 48
people 42.9
silhouette 42.2
audience 41.9
lights 38.9
stadium 38.9
nation 37.9
patriotic 37.4
flag 36.8
cheering 36.2
nighttime 35.2
vibrant 31.5
icon 30.9
symbol 28.9
group 27.4
vivid 26.9
man 26.9
design 25.3
event 25
teacher 24.1
athlete 23.8
bright 23.6
match 23.2
training 23.1
competition 22.9
championship 22.4
skill 22.1
student 22.1
sport 22.1
muscular 22
male 20.6
team 19.7
business 18.8
music 18.1
businessman 17.6
concert 17.5
men 17.2
blackboard 17
glowing 16.6
versus 15.8
musician 15.4
musical 15.3
stage 14.9
playing 14.6
band 14.6
world 14.1
education 13.9
professional 13.8
sword 13.7
performance 13.4
dangerous 13.3
sharp 13.3
teamwork 13
stab 12.8
fencing 12.8
guitar 12.8
technique 12.8
protection 12.7
live 12.7
player 12.7
blade 12.6
weapon 12.6
fight 12.6
gear 12.6
meeting 12.2
bass 11.9
businesswoman 11.8
instruments 11.8
work 11.8
classical 11.5
enrollee 11.4
adult 11.4
school 11.3
human 11.2
electric 11.2
educator 11.1
shiny 11.1
occupation 11
blues 10.8
acoustic 10.8
jazz 10.8
center 10.8
pop 10.7
practice 10.6
hand 10.6
success 10.5
drums 9.9
teaching 9.7
job 9.7
class 9.6
women 9.5
presentation 9.3
field 9.2
board 9
office 9
platform 8.9
ball 8.9
shoot 8.7
soccer 8.7
goal 8.6
corporate 8.6
interior 8
boy 7.8
kick 7.8
students 7.8
pass 7.8
football 7.7
boss 7.6
life 7.4
star 7.4
portrait 7.1
happiness 7.1

Google
created on 2022-02-04

Black-and-white 86.6
Style 84.1
Font 82.4
Adaptation 79.3
Art 78.8
Monochrome 76.7
Monochrome photography 76.3
Event 72.5
Suit 71.9
Room 66.3
Visual arts 65.7
Crew 58.1
Team 57.1
Illustration 56.2
Crowd 55.6
Photographic paper 54.6
Advertising 54.2
Display device 53.5
Brand 53
History 52

Microsoft
created on 2022-02-04

clothing 95.7
text 93.8
person 92.2
footwear 79.1
group 70.9
man 70.7
woman 61.3
people 59.5
posing 50.7
black and white 50.3

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 93.4%
Happy 68.9%
Sad 9.1%
Calm 8.4%
Disgusted 3.8%
Surprised 3.2%
Confused 2.6%
Angry 2%
Fear 1.9%

AWS Rekognition

Age 45-51
Gender Male, 99%
Sad 62.4%
Calm 21.6%
Happy 10%
Fear 1.7%
Disgusted 1.3%
Angry 1.2%
Confused 1%
Surprised 0.8%

AWS Rekognition

Age 36-44
Gender Male, 92%
Happy 36.9%
Confused 35.3%
Sad 24%
Calm 1.3%
Disgusted 0.8%
Surprised 0.7%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 50-58
Gender Male, 81.6%
Happy 45.6%
Calm 44.1%
Disgusted 3.1%
Angry 2.1%
Sad 1.6%
Surprised 1.2%
Fear 1.2%
Confused 1.1%

AWS Rekognition

Age 39-47
Gender Male, 95.5%
Calm 42.8%
Sad 27.3%
Happy 23.5%
Confused 2.2%
Surprised 1.5%
Angry 1.3%
Disgusted 1.1%
Fear 0.4%

AWS Rekognition

Age 31-41
Gender Male, 75%
Happy 56.4%
Sad 23.4%
Calm 12.5%
Confused 4.4%
Surprised 1%
Angry 1%
Disgusted 0.8%
Fear 0.5%

AWS Rekognition

Age 41-49
Gender Male, 85.4%
Calm 78.1%
Surprised 7.2%
Happy 6.9%
Sad 5.4%
Confused 0.8%
Angry 0.7%
Disgusted 0.7%
Fear 0.4%

AWS Rekognition

Age 47-53
Gender Male, 71.7%
Sad 93.5%
Calm 1.7%
Confused 1.5%
Fear 1.1%
Happy 0.8%
Disgusted 0.6%
Angry 0.5%
Surprised 0.2%

AWS Rekognition

Age 31-41
Gender Female, 57.7%
Happy 88.6%
Calm 3.1%
Sad 2.7%
Surprised 2%
Confused 1.6%
Angry 0.9%
Disgusted 0.8%
Fear 0.4%

AWS Rekognition

Age 11-19
Gender Male, 99.6%
Sad 77.6%
Calm 9.1%
Happy 4.8%
Confused 4.7%
Surprised 1.5%
Angry 0.9%
Disgusted 0.9%
Fear 0.4%

AWS Rekognition

Age 51-59
Gender Male, 92%
Happy 38.1%
Calm 27.8%
Disgusted 9.4%
Confused 7.3%
Angry 6.2%
Sad 5.1%
Fear 4.7%
Surprised 1.4%

AWS Rekognition

Age 22-30
Gender Male, 99.9%
Sad 99.7%
Confused 0.1%
Calm 0.1%
Happy 0%
Angry 0%
Fear 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 28-38
Gender Female, 88.5%
Calm 59%
Sad 18.5%
Happy 14.8%
Confused 3.9%
Surprised 1.4%
Disgusted 1.1%
Angry 0.9%
Fear 0.5%

AWS Rekognition

Age 25-35
Gender Male, 97.5%
Calm 92.4%
Sad 3.7%
Confused 1.9%
Happy 0.9%
Fear 0.4%
Angry 0.3%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Female, 98.6%
Sad 97.8%
Confused 1.3%
Calm 0.5%
Fear 0.2%
Happy 0.1%
Angry 0%
Disgusted 0%
Surprised 0%

AWS Rekognition

Age 23-33
Gender Male, 72.1%
Confused 65.3%
Sad 26.6%
Calm 3.5%
Surprised 2.1%
Angry 1%
Disgusted 0.6%
Happy 0.4%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Tie 62.6%

Captions

Microsoft

a group of people posing for a photo 95.9%
a group of people posing for the camera 95.8%
a group of people posing for a picture 95.7%

Text analysis

Amazon

DAY
EVERY
FRESHNESS
rapes
RRIES
F
P
JERSY
FRESH JERSY
FRESH
SMART

Google

EVERY
FRESHNESS
DAY
PRIES
PRIES FRESHNESS EVERY DAY EVERY DAY