Human Generated Data

Title

Untitled (men dressed as cowgirls sitting on the backs of men dressed as cowboys
Date

1939
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4960
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men dressed as cowgirls sitting on the backs of men dressed as cowboys

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1939

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.6
Musician 97.5
Musical Instrument 97.5
Person 96.6
Leisure Activities 93.3
Guitar 89.9
Person 88.4
Person 85.3
Music Band 84
Crowd 75.7
People 74.3
Performer 72.4
Guitarist 72.4
Person 70.1
Person 69.7
Person 65.1
Person 65
Dance Pose 59.1
Dance 58.2
Apparel 57.3
Shorts 57.3
Clothing 57.3
Coat 57
Overcoat 57
Suit 57
Banjo 56.5
Stage 55.7

Imagga
created on 2022-01-23

x-ray film 43.8
film 37.1
photographic paper 26.5
equipment 19
photographic equipment 17.6
blackboard 16.5
symbol 15.5
graphic 14.6
glass 14.1
art 14.1
business 14
tray 12.7
technology 12.6
ripple 12.4
liquid 12.2
sign 12
design 11.8
world 11.5
waving 10.7
container 10.5
education 10.4
receptacle 10.3
water 10
close 9.7
shape 9.5
light 9.4
clip 9.3
3d 9.3
silhouette 9.1
drop 9.1
black 9
metal 8.8
medical 8.8
celebration 8.8
party 8.6
wine 8.3
pattern 8.2
rippling 7.9
wave 7.8
patriotism 7.7
search 7.7
modern 7.7
class 7.7
wavy 7.7
navigation 7.7
crowd 7.7
patriotic 7.7
grunge 7.7
state 7.6
research 7.6
hand 7.6
biology 7.6
man 7.6
nation 7.6
website 7.5
fabric 7.5
commerce 7.5
flag 7.4
closeup 7.4
glasses 7.4
backgrounds 7.3
national 7.2
decoration 7.2
financial 7.1
science 7.1
male 7.1
steel 7.1
silver 7.1
reflection 7.1
chemical 7
medicine 7
country 7

Google
created on 2022-01-23

Font 83.8
Snapshot 74.3
Metal 67.5
Event 67.5
Rectangle 62.7
Circle 60.9
Advertising 58.8
Graphics 57.7
Art 55.1
Team 54.6
Photo caption 51.4

Microsoft
created on 2022-01-23

text 99.4
drawing 98.3
sketch 91.3
dance 84.6
cartoon 81.1
posing 77.6
group 55.8
old 44

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 99.1%
Calm 45.5%
Sad 34.5%
Disgusted 5.8%
Angry 5.5%
Happy 3.7%
Confused 2.5%
Surprised 1.6%
Fear 1%

AWS Rekognition

Age 45-51
Gender Male, 99.7%
Sad 94.8%
Calm 3%
Disgusted 0.8%
Confused 0.5%
Angry 0.4%
Fear 0.3%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.6%
Calm 76%
Sad 12.4%
Happy 6%
Fear 1.5%
Disgusted 1.3%
Confused 1.2%
Angry 0.9%
Surprised 0.6%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Happy 73.8%
Sad 12.1%
Confused 5.1%
Calm 3.8%
Surprised 1.8%
Disgusted 1.7%
Angry 1%
Fear 0.6%

AWS Rekognition

Age 41-49
Gender Male, 99.6%
Sad 73.4%
Disgusted 12.6%
Confused 5.1%
Calm 3.2%
Happy 2.5%
Fear 1.3%
Angry 1.3%
Surprised 0.7%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Surprised 60.3%
Sad 15.7%
Calm 14.9%
Happy 2.6%
Fear 2%
Confused 1.7%
Disgusted 1.7%
Angry 1.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.6%
Guitar 89.9%

Captions

Microsoft

a group of people posing for a photo 86.7%
a group of people posing for a picture 86.6%
a group of people posing for the camera 86.5%

Text analysis

Amazon

10901.

Google

XXXXXX
10901. XXXXXX XXXXXX
10901.