Human Generated Data

Title

Untitled (group scene in Western wear by "Rodeo Jail")

Date

c. 1955

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.2300

Human Generated Data

Title

Untitled (group scene in Western wear by "Rodeo Jail")

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-30

Human 99.6
Person 99.6
Person 99.5
Person 99.4
Person 99.1
Person 98.9
Person 98.1
Person 96.9
Sailor Suit 96.1
Apparel 95.6
Clothing 95.6
Footwear 95
Shoe 95
Shoe 94.1
Person 88.6
Hat 86.7
Person 86.7
Person 80.6
Hat 76.9
Shorts 76.4
Sunglasses 73.8
Accessory 73.8
Accessories 73.8
Officer 66.7
Military Uniform 66.7
Military 66.7
People 65.4
Crowd 64.1
Sunglasses 62.7
Person 58.8
Nurse 58.1
Coat 57.3
Shoe 51.2

Imagga
created on 2022-01-30

people 31.8
man 30.9
male 28.3
men 25.7
work 24.3
business 24.3
person 22.3
adult 19.8
job 19.4
shop 17.6
clothing 17.1
worker 16.8
professional 16.4
nurse 16
women 15.8
occupation 15.6
building 14.9
urban 14.8
businessman 14.1
musical instrument 12.7
helmet 12.5
medical 12.3
black 12
industry 11.9
office 11.9
architecture 11.7
city 11.6
working 11.5
uniform 11
industrial 10.9
equipment 10.9
happy 10.6
percussion instrument 10.5
serious 10.5
group 10.5
standing 10.4
engineer 10.4
clothes 10.3
construction 10.3
foreman 10.2
profession 9.6
hat 9.5
smiling 9.4
doctor 9.4
patient 9.4
two 9.3
manager 9.3
smile 9.3
safety 9.2
street 9.2
bass 9.2
steel drum 9.2
portrait 9.1
fashion 9
human 9
team 9
barbershop 8.9
looking 8.8
indoors 8.8
architect 8.7
hospital 8.6
happiness 8.6
life 8.6
world 8.5
mercantile establishment 8.2
suit 8.1
builder 8
success 8
medicine 7.9
supervisor 7.9
student 7.8
seller 7.8
travel 7.7
corporate 7.7
laboratory 7.7
diversity 7.7
health 7.6
ethnic 7.6
store 7.6
room 7.4
brass 7.3
protection 7.3
activity 7.2
device 7.2
handsome 7.1
modern 7

Google
created on 2022-01-30

Microsoft
created on 2022-01-30

text 97.6
person 97.1
clothing 96.2
black and white 88.8
man 84.1
cartoon 65.7

Face analysis

Amazon

Google

AWS Rekognition

Age 49-57
Gender Male, 99.9%
Calm 59.8%
Sad 18.1%
Happy 16.7%
Surprised 1.8%
Angry 1.4%
Confused 1%
Disgusted 0.7%
Fear 0.6%

AWS Rekognition

Age 51-59
Gender Male, 99.5%
Fear 50.7%
Calm 36.2%
Sad 4.1%
Disgusted 2.9%
Confused 2.7%
Surprised 2%
Happy 1.2%
Angry 0.3%

AWS Rekognition

Age 23-33
Gender Female, 90.7%
Calm 92.1%
Sad 5.3%
Surprised 1%
Confused 0.6%
Disgusted 0.4%
Happy 0.2%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Female, 64.1%
Calm 51.7%
Surprised 38.3%
Angry 3.6%
Happy 2.4%
Fear 1.3%
Disgusted 1.2%
Sad 0.8%
Confused 0.7%

AWS Rekognition

Age 27-37
Gender Female, 69.7%
Calm 89.7%
Sad 9.4%
Angry 0.6%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Shoe 95%
Hat 86.7%
Sunglasses 73.8%

Captions

Microsoft

a man standing in front of a store 75.8%
a group of people standing in front of a store 69.7%
a man standing in front of a refrigerator 48.9%

Text analysis

Amazon

SHOP
UTY SHOP
UTY
RODEO
JUNE
TEXAS
1-2-3
D
H
107
RODEO JAiL
JAiL
LOCKHANT. TEXAS
JAIL
Chempiseship
LOCKHANT.
WHIS Chempiseship
LIFW
KODEK--EELX LIFW
WHIS
KODEK--EELX

Google

UTY
RODEO
JUNE
UTY SHOP RODEO ECART. TEAS JUNE ODEO JAL 123 107 H 是鮮
JAL
107
H
SHOP
TEAS
123
ECART.
ODEO