Human Generated Data

Title

Untitled (man on street looking in at mannequin in window)
Date

c. 1950, printed later
People

Artist: Jack Gould, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.187

Human Generated Data

Title

Untitled (man on street looking in at mannequin in window)

People

Artist: Jack Gould, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Person 99.8
Human 99.8
Person 98.7
Person 98.3
Clothing 96.7
Apparel 96.7
Shoe 96.3
Footwear 96.3
Person 96.2
Suit 94.8
Overcoat 94.8
Coat 94.8
Shoe 93.6
Person 93.3
Military 91.2
Person 90.2
Military Uniform 89.2
Officer 87.8
Person 85.7
Person 85.6
Shoe 77.5
Shoe 75.5
Sailor Suit 70.3
Pedestrian 69.3
People 65.1
Flooring 62.7
Portrait 60.2
Photography 60.2
Face 60.2
Photo 60.2
Floor 58.9
Sleeve 56.4
Advertisement 55.5
Shoe 54.5

Imagga
created on 2021-12-14

business 36.5
people 34
office 30.3
man 29.6
men 27.5
urban 27.1
male 26.3
corporate 25.8
building 25.1
city 24.1
professional 23.3
businessman 23
suit 21.9
briefcase 21.1
group 19.4
silhouette 19.1
women 19
walking 19
black 18.8
success 18.5
walk 18.1
work 18.1
person 17.1
job 16.8
happy 16.3
adult 15.8
executive 15.7
architecture 15.7
attractive 15.4
team 15.2
successful 14.6
businesswoman 14.5
window 14.1
pretty 14
company 14
motion 13.7
career 13.3
meeting 13.2
manager 13
crowd 12.5
working 12.4
smile 12.1
human 12
travel 12
street 12
boss 11.5
reflection 11.4
modern 11.2
occupation 11
corridor 10.8
indoors 10.5
life 10.5
teamwork 10.2
indoor 10.1
gate 10
passenger 9.9
door 9.9
worker 9.8
airport 9.8
sales 9.6
standing 9.6
lifestyle 9.4
glass 9.3
university 9.3
staff 9.2
fashion 9.1
lady 8.9
subway 8.9
interior 8.9
entrance 8.7
corporation 8.7
move 8.6
cute 8.6
employee 8.6
ethnic 8.6
portrait 8.4
student 8.2
musical instrument 8.1
support 8.1
device 8.1
hall 8
station 8
sliding door 7.9
leaving 7.9
crutch 7.9
telephone 7.8
construction 7.7
diversity 7.7
traffic 7.6
jacket 7.5
floor 7.4
back 7.4
transport 7.3
confident 7.3
transportation 7.2
activity 7.2
bag 7.1
clothing 7.1

Google
created on 2021-12-14

Standing 86.4
Coat 85.9
Gesture 85.3
Black-and-white 84.5
Style 84
Suit 81.6
Street fashion 80.2
Blazer 78.3
Formal wear 76.1
Font 75.3
White-collar worker 73.3
Monochrome photography 71.7
Monochrome 70.4
Event 68.4
Rectangle 65.2
Happy 65.1
Stock photography 63.8
Street 62.9
Room 58.9
Pedestrian 56.6

Microsoft
created on 2021-12-14

text 98.2
man 86
black and white 84.7
person 80.2
clothing 78.6
street 76.3

Face analysis

Amazon

Google

AWS Rekognition

Age 27-43
Gender Male, 99.1%
Calm 97.5%
Sad 1.1%
Surprised 0.5%
Angry 0.4%
Disgusted 0.2%
Confused 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 16-28
Gender Male, 74.2%
Calm 98.1%
Sad 0.6%
Angry 0.6%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 21-33
Gender Male, 99.6%
Calm 97.9%
Sad 1.6%
Confused 0.3%
Angry 0.1%
Surprised 0%
Fear 0%
Disgusted 0%
Happy 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Shoe 96.3%
Suit 94.8%

Captions

Microsoft

a group of people walking down a street 89.1%
a group of people walking down the street 89%
a group of people standing in front of a building 84.5%

Text analysis

Amazon

LOANS
G
Reaction

Google

IOANS
IOANS