Human Generated Data

Title

Untitled (four female high school students posed sitting at edge of gym bleachers)

Date

1961

People

Artist: Claseman Studio, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.11050

Human Generated Data

Title

Untitled (four female high school students posed sitting at edge of gym bleachers)

People

Artist: Claseman Studio, American 20th century

Date

1961

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-03-25

Person 99.4
Human 99.4
Person 99.4
Person 99.3
Person 98.8
Face 88.7
Female 88.6
Child 80.9
Girl 80.9
Woman 80.9
Blonde 80.9
Teen 80.9
Kid 80.9
Outdoors 74.2
Nature 69.7
Meal 66
Food 66
Jury 64.2
People 63.9
Building 62.8
Sitting 61
Apparel 59.7
Overcoat 59.7
Clothing 59.7
Suit 59.7
Coat 59.7
Furniture 59.1
Window 56.4
Weather 55.7
Indoors 55.1
Room 55.1
Urban 55

Clarifai
created on 2019-03-25

people 99.5
group 98.4
group together 98.3
adult 97.3
woman 96.7
man 94.9
many 94.9
vehicle 91.4
wear 91.1
administration 85.5
watercraft 84
portrait 83.9
leader 83.6
music 83.3
several 81.1
three 80.4
furniture 79.5
five 79.2
military 77.7
room 76.6

Imagga
created on 2019-03-25

man 29.5
people 26.2
male 22.7
office 21.7
modern 19.6
adult 18.9
home 18.3
room 18.3
business 17.6
happy 16.9
interior 16.8
person 16.8
sitting 14.6
couple 13.9
car 13.8
smiling 13.7
indoor 12.8
women 11.8
house 11.7
window 11.5
businessman 11.5
furniture 11.3
smile 10.7
table 10.6
indoors 10.5
portrait 10.3
love 10.2
percussion instrument 10.2
lifestyle 10.1
glass 10.1
outdoors 9.7
chair 9.6
television 9.5
happiness 9.4
casual 9.3
two 9.3
vehicle 9.1
holding 9.1
old 9
human 9
wheeled vehicle 8.9
new 8.9
family 8.9
working 8.8
musical instrument 8.8
together 8.7
building 8.7
standing 8.7
work 8.6
corporate 8.6
men 8.6
career 8.5
friends 8.4
design 8.4
relaxation 8.4
mature 8.4
wood 8.3
life 8.3
kitchen 8.2
cheerful 8.1
lady 8.1
team 8
computer 8
light 8
looking 8
black 7.8
horizontal 7.5
senior 7.5
floor 7.4
structure 7.4
style 7.4
board 7.3
group 7.2
passenger 7.2
decor 7.1
day 7

Google
created on 2019-03-25

Photograph 96.9
Text 86.9
Snapshot 86.6
Photography 67.8
Room 65.7
Black-and-white 56.4

Microsoft
created on 2019-03-25

Face analysis

Amazon

AWS Rekognition

Age 26-43
Gender Male, 95.5%
Surprised 3%
Angry 3.6%
Sad 48.1%
Calm 23.3%
Happy 15.4%
Confused 4.2%
Disgusted 2.3%

AWS Rekognition

Age 26-43
Gender Female, 89%
Disgusted 0.5%
Surprised 1.3%
Calm 7.9%
Happy 85.4%
Sad 1.8%
Confused 1%
Angry 2.1%

AWS Rekognition

Age 10-15
Gender Male, 50.8%
Happy 53.5%
Surprised 45.1%
Disgusted 45%
Calm 45.5%
Sad 45.8%
Confused 45%
Angry 45.1%

AWS Rekognition

Age 26-44
Gender Male, 65%
Surprised 0.8%
Angry 0.8%
Disgusted 0.2%
Happy 9.6%
Sad 1.3%
Confused 1.4%
Calm 85.9%

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people standing in front of a window 88.1%
a group of people posing for a photo in front of a window 87.1%
a group of people in front of a window 86.6%

Text analysis

Amazon

SAFETY
KODAK
KODAK SAFETY FILM
FILM

Google

KODAK
SAFETY
2
FILM
KODAK SAFETY FILM 2