Human Generated Data

Title

Untitled (men dressed as cowgirls sitting on the backs of men dressed as cowboys
Date

1937
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4959
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (men dressed as cowgirls sitting on the backs of men dressed as cowboys

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1937

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 97.9
Room 97.2
Indoors 97.2
Musical Instrument 92.7
Musician 92.7
Person 92.1
Person 87.3
Crowd 86
Theater 85
Music Band 81.4
Leisure Activities 79.5
Person 79.1
Interior Design 77.9
Person 74.9
Person 74.7
Concert 70.5
Guitar 65.7
People 63.3
Orchestra 56.1
Person 43.9

Imagga
created on 2022-01-23

glass 31.6
medical 22.9
beaker 22.3
equipment 21
laboratory 20.3
research 19
chemistry 18.4
container 18.2
biology 18
chemical 17.7
medicine 16.7
experiment 16.6
liquid 16.5
graphic 16
glassware 15.7
symbol 15.5
business 14.6
lab 14.6
ripple 14.3
science 14.2
technology 14.1
development 13.7
aqua 13.3
x-ray film 13
glasses 13
h2o 12.8
water 12.7
wine 12.4
film 12.3
wineglass 12.2
measure 12.2
design 11.8
biotechnology 11.8
waving 11.7
fluid 11.7
pharmacy 11.7
jar 11.6
world 11.5
silver 11.5
solution 11.4
clip 11.3
sign 11.3
fork 10.9
rippling 10.8
art 10.7
patriotism 10.6
wavy 10.6
patriotic 10.5
state 10.5
nation 10.4
fabric 10.4
commerce 10.3
flag 10.1
national 10
sterilize 9.9
vessel 9.8
sterile 9.8
health 9.7
country 9.7
test 9.6
clear 9.6
industry 9.4
drink 9.2
close 9.1
element 9.1
flask 8.8
sample 8.8
objects 8.7
set 8.5
transparent 8.1
metal 8
financial 8
photographic paper 8
acid 7.9
pharmaceutical 7.8
kitchenware 7.8
examination 7.8
scientific 7.8
party 7.7
navigation 7.7
growing 7.6
dumbbell 7.4
holder 7.1
steel 7.1

Google
created on 2022-01-23

Font 83.6
Rectangle 72.5
Art 69.8
Metal 69
Circle 68.1
Fashion accessory 67.2
Drinkware 67.1
Monochrome 66.9
Monochrome photography 66
Event 63.7
Brand 62.6
Stock photography 62.4
Graphics 61.9
Still life photography 59.5
Logo 57.4
Body jewelry 54.3
Pattern 54.1
Jewellery 54
Glass bottle 53.3
Graphic design 53.2

Microsoft
created on 2022-01-23

text 99.6
drawing 95
posing 75.8
soft drink 66
sketch 51

Face analysis

Amazon

Google

AWS Rekognition

Age 37-45
Gender Male, 99.8%
Sad 71.4%
Calm 13.4%
Happy 6.1%
Confused 5.8%
Disgusted 1.2%
Angry 0.9%
Surprised 0.8%
Fear 0.4%

AWS Rekognition

Age 36-44
Gender Male, 99.6%
Sad 99.6%
Calm 0.1%
Fear 0.1%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Happy 0%
Surprised 0%

AWS Rekognition

Age 31-41
Gender Male, 99.9%
Confused 37%
Calm 23.2%
Disgusted 13.3%
Surprised 9.8%
Sad 9.1%
Happy 3.4%
Fear 2.8%
Angry 1.4%

AWS Rekognition

Age 40-48
Gender Female, 57.4%
Disgusted 61.1%
Sad 30.4%
Confused 2.2%
Happy 2.2%
Calm 1.9%
Angry 0.9%
Surprised 0.8%
Fear 0.6%

AWS Rekognition

Age 35-43
Gender Female, 72.6%
Sad 81.5%
Calm 9.2%
Confused 4.3%
Fear 2.1%
Disgusted 1.1%
Angry 0.8%
Happy 0.6%
Surprised 0.5%

AWS Rekognition

Age 45-51
Gender Female, 60.7%
Calm 99.9%
Surprised 0%
Confused 0%
Disgusted 0%
Sad 0%
Happy 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 31-41
Gender Male, 85.9%
Sad 55.6%
Calm 23.4%
Confused 7.8%
Disgusted 7.8%
Happy 2.3%
Angry 1.3%
Surprised 1.1%
Fear 0.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 92.1%
Guitar 65.7%

Captions

Microsoft

a group of people posing for a photo 59.7%
a group of people posing for the camera 59.6%
a group of people posing for a picture 59.5%

Text analysis

Amazon

10902
10902.

Google

Jo9•2.
Jo9•2. 10902.
10902.