Human Generated Data

Title

Untitled (graduation; boys standing on stage, others seated)
Date

1956
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.15016

Human Generated Data

Title

Untitled (graduation; boys standing on stage, others seated)

People

Artist: Jack Gould, American

Date

1956

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 99
Human 99
Person 98.9
Person 98.5
Person 98.1
Person 97.6
Person 96.9
Poster 91.7
Advertisement 91.7
Person 88.8
Clothing 86.9
Apparel 86.9
Chair 82.6
Furniture 82.6
Coat 75.3
Overcoat 75.3
Suit 75.3
Text 71.3
Sitting 69.2
Crowd 67
Face 66.3
People 63.4
Sleeve 58.8
Flooring 57.4

Imagga
created on 2022-03-05

blackboard 35.8
people 32.9
silhouette 32.3
person 31.9
man 27.5
male 24.8
businessman 22.9
business 21.2
crowd 20.2
group 20.1
team 19.7
teacher 19.7
vibrant 18.4
men 17.2
nation 17
design 16.9
flag 16.4
symbol 16.1
adult 15.9
lights 15.8
classroom 15.7
cheering 15.7
black 15.6
audience 15.6
education 15.6
stadium 15.6
patriotic 15.3
sport 15
nighttime 14.7
job 14.2
work 14.1
player 14.1
school 13.6
bright 13.6
board 13.6
barbershop 13.3
room 13.2
event 12.9
icon 12.7
class 12.5
vivid 12.1
glowing 12
human 12
women 11.9
professional 11.7
shop 11.3
student 11
athlete 10.8
happy 10.6
modern 10.5
college 10.4
portrait 10.4
shiny 10.3
teamwork 10.2
training 10.2
hand 9.9
success 9.7
skill 9.6
employee 9.6
muscular 9.5
corporate 9.4
meeting 9.4
light 9.4
presentation 9.3
occupation 9.2
competition 9.1
indoor 9.1
world 9.1
businesswoman 9.1
mercantile establishment 9
teaching 8.8
standing 8.7
hands 8.7
match 8.7
office 8.4
manager 8.4
chalkboard 7.8
math 7.8
mathematics 7.8
championship 7.8
film 7.7
drawing 7.7
leader 7.7
musician 7.7
motion 7.7
youth 7.7
boss 7.6
chart 7.6
communication 7.6
field 7.5
study 7.5
park 7.4
sexy 7.2
music 7.2
financial 7.1
smile 7.1
ball 7.1

Google
created on 2022-03-05

Coat 86.6
Black-and-white 84.5
Style 83.9
Chair 82.9
Font 81.3
Suit 79.9
Art 77.3
Monochrome photography 75.4
Monochrome 73.8
Event 69.4
Formal wear 68.5
Vintage clothing 68.4
Design 68.3
Room 68.2
Advertising 63.9
Visual arts 63.2
Fashion design 63.2
White-collar worker 63
Stock photography 62.8
Illustration 62.3

Microsoft
created on 2022-03-05

text 99.8
person 99.4
clothing 97.9
man 93.6
standing 76.8
poster 57.7

Face analysis

Amazon

Google

AWS Rekognition

Age 29-39
Gender Male, 87.9%
Calm 99.7%
Sad 0.2%
Disgusted 0%
Surprised 0%
Fear 0%
Angry 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 37-45
Gender Male, 98.3%
Calm 100%
Sad 0%
Disgusted 0%
Surprised 0%
Angry 0%
Fear 0%
Happy 0%
Confused 0%

AWS Rekognition

Age 28-38
Gender Male, 98.9%
Calm 99.2%
Sad 0.3%
Happy 0.1%
Angry 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 96.5%
Calm 51.8%
Fear 20.8%
Happy 14.2%
Surprised 6.3%
Sad 3.4%
Disgusted 1.5%
Confused 1.4%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Poster 91.7%

Captions

Microsoft

a group of people standing in front of a crowd 83.1%
a group of people standing in front of a crowd posing for the camera 78.8%
a group of people standing in front of a crowd of people 78.7%

Text analysis

Amazon

Freund
FILM
KODAK
SAFETY FILM
OF
SAFETY
ANNIVERSARIES
MEDLEY OF ANNIVERSARIES
UNION OF ST LOUIS
UNION
LOUIS
BAKING
SOCIETY
ST
ALL-AROUND
OLDE
MEDLEY
OLDE TYME
TYME
AND
ALL-AROUND GENIUS
CADEMY OF
GENIUS
ERS
CADEMY
ON
ERS ASSOCIATION
RAPHICAL
PRODUCTS
ASSOCIATION
B
BAKING COMPANY
DERTAL SOCIETY
3
COMPANY
100
SCIENCE
DERTAL
BANKLIN.
ANICA
ATE
IODYEARS
assi
ATE TS
ICUP
TS
TRITAMONAL
NOVI
SERIES

Google

Freund
PRODECTS
AMEDLEY
COMPANY
OF
SCIENCE.
BANKLIN.
ANNIVERSARIES OLDE Freund PRODECTS AMEDLEY OF ANNIVERSARIES BAKING COMPANY DENTAL SOCIETY. CADEMY OF SCIENCE. RAPHICAL UNION OF ST. LOUIS. BANKLIN. ALL-AROUND GENIUS WTE T BRS ASSOCIATION. ICUI OVEARS AND WANICA OC ON TIME KODAK SAFETY FILM KODAK
OLDE
RAPHICAL
OC
TIME
ANNIVERSARIES
AND
KODAK
DENTAL
UNION
ALL-AROUND
GENIUS
ICUI
ON
BAKING
SOCIETY.
CADEMY
ST.
LOUIS.
WTE
T
BRS
ASSOCIATION.
OVEARS
WANICA
SAFETY
FILM