Human Generated Data

Title

Untitled (passengers on crowded city bus)

Date

c. 1950

People

Artist: Jack Gould, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.16080

Human Generated Data

Title

Untitled (passengers on crowded city bus)

People

Artist: Jack Gould, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-25

Human 99.3
Person 99.3
Person 98.9
Person 98.5
Person 98
Person 97.2
Vehicle 94.1
Transportation 94.1
Person 93.7
Person 93.1
Person 91.4
Person 89.5
Train 85.2
Terminal 74.3
Train Station 74.3
Person 69.3
Worker 69.2
Person 68.3
Person 68.1
People 63.9
Cable Car 55.4

Imagga
created on 2022-03-25

shop 29.1
people 24.5
barbershop 23.6
building 21.9
mercantile establishment 19.9
conveyance 19.5
man 19.5
wheeled vehicle 18.1
boutique 17.7
architecture 16.6
streetcar 16.3
city 15.8
business 15.8
window 15.7
urban 15.7
tramway 15.4
office 15.2
groom 15.1
interior 15
male 14.9
adult 13.6
old 13.2
place of business 13.2
life 11.8
dress 11.7
vehicle 11.6
family 11.6
passenger 11.5
train 11.3
couple 11.3
wagon 11.1
transportation 10.7
bride 10.5
modern 10.5
men 10.3
hall 10.2
historic 10.1
travel 9.8
new 9.7
subway train 9.6
women 9.5
happy 9.4
glass 9.3
wedding 9.2
house 9.2
transport 9.1
black 9
businessman 8.8
station 8.8
person 8.6
portrait 8.4
inside 8.3
center 8
home 8
indoors 7.9
love 7.9
happiness 7.8
art 7.8
mall 7.8
ancient 7.8
culture 7.7
bouquet 7.5
human 7.5
traditional 7.5
structure 7.4
room 7.4
indoor 7.3
celebration 7.2
holiday 7.2
case 7

Microsoft
created on 2022-03-25

person 90.4
train 88.5
text 84.1
clothing 83.9
people 77.8
bus 58.4
man 58
black and white 52.7
vehicle 50.9
clothes 17.1
crowd 0.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 52-60
Gender Female, 100%
Sad 81.5%
Calm 15.2%
Fear 1%
Confused 0.8%
Angry 0.6%
Surprised 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 52-60
Gender Male, 100%
Calm 90.8%
Fear 2.7%
Surprised 1.9%
Confused 1.7%
Sad 1.2%
Disgusted 1%
Angry 0.5%
Happy 0.3%

AWS Rekognition

Age 6-14
Gender Female, 100%
Calm 96.7%
Confused 1.2%
Disgusted 0.9%
Fear 0.5%
Surprised 0.3%
Angry 0.3%
Sad 0.2%
Happy 0.1%

AWS Rekognition

Age 33-41
Gender Female, 98.3%
Calm 60.9%
Happy 26.2%
Angry 7.9%
Disgusted 1.9%
Sad 1%
Surprised 0.9%
Fear 0.8%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Female, 96.6%
Sad 85.8%
Calm 10.2%
Confused 2.6%
Fear 0.4%
Angry 0.4%
Disgusted 0.4%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 22-30
Gender Female, 86.4%
Sad 99.8%
Calm 0.1%
Confused 0%
Fear 0%
Disgusted 0%
Angry 0%
Happy 0%
Surprised 0%

AWS Rekognition

Age 52-60
Gender Male, 82.6%
Calm 99%
Sad 0.2%
Disgusted 0.2%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Angry 0.1%
Happy 0%

AWS Rekognition

Age 18-26
Gender Female, 100%
Disgusted 41.8%
Fear 31.4%
Calm 7.8%
Angry 7.7%
Surprised 3.7%
Happy 3%
Confused 2.9%
Sad 1.5%

AWS Rekognition

Age 27-37
Gender Male, 94.1%
Calm 96.1%
Sad 1.7%
Happy 1.2%
Confused 0.5%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Male, 96.5%
Calm 92.7%
Sad 4%
Surprised 1.6%
Fear 0.4%
Disgusted 0.4%
Happy 0.3%
Angry 0.3%
Confused 0.2%

AWS Rekognition

Age 22-30
Gender Female, 100%
Calm 97.8%
Surprised 1%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Sad 0.2%
Fear 0.1%
Happy 0.1%

AWS Rekognition

Age 20-28
Gender Male, 96.2%
Calm 69.1%
Disgusted 12.7%
Sad 9.7%
Surprised 3.7%
Confused 2.2%
Angry 1.2%
Fear 0.9%
Happy 0.5%

AWS Rekognition

Age 29-39
Gender Male, 99.7%
Calm 52.3%
Confused 18.3%
Sad 11.2%
Surprised 8.3%
Fear 4.4%
Angry 2.7%
Disgusted 1.5%
Happy 1.3%

AWS Rekognition

Age 13-21
Gender Male, 94.6%
Sad 86.1%
Calm 9%
Happy 2.4%
Surprised 0.7%
Disgusted 0.5%
Angry 0.4%
Confused 0.4%
Fear 0.4%

Microsoft Cognitive Services

Age 23
Gender Female

Microsoft Cognitive Services

Age 52
Gender Female

Microsoft Cognitive Services

Age 23
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%

Captions

Microsoft

a group of people standing in front of a crowd 95.4%
a group of people standing in front of a crowd posing for the camera 94.2%
a group of people standing in front of a store 92.7%

Text analysis

Amazon

8
KODAK
SAFETY
KOD
F
FILM
FREE
APRIL
FREE RIDE HO
16-17-18 APRIL
RIDE HO
16-17-18
SALE
DOWNTOWN SALE
WRIGLEY'S
DOWNTOWN
America

Google

FILM
SA
FETY
KOD
8. KODAK SA FETY FILM KOD
8.
KODAK