Human Generated Data

Title

Untitled (women at Tupperware party)

Date

1958

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4612

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (women at Tupperware party)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 98.7
Person 98.7
Person 98.6
Person 97
Person 96.3
Person 95.5
Person 95.3
Person 95.1
Person 94.1
Person 93.4
Person 93.4
Person 92.3
Person 89.1
People 82.4
Crowd 80.9
Chair 77.1
Furniture 77.1
Chess 71.6
Game 71.6
Apparel 60.6
Clothing 60.6
Person 48.1

Imagga
created on 2021-12-14

container 46.6
glass 40.1
chemical 32.8
beaker 32.3
research 31.4
biology 31.3
chemistry 30.9
laboratory 29.9
equipment 29.6
science 29.3
experiment 29.2
liquid 27.8
medical 27.3
flask 26.5
lab 25.2
development 23.7
glassware 22.5
pharmacy 21.3
scientific 21.3
vessel 20.9
cup 20.8
biotechnology 20.6
tube 20.2
medicine 20.2
test 20.2
acid 19.6
water 18.7
glasses 18.5
fluid 18.4
aqua 18.1
measure 17.9
h2o 17.7
scientist 17.6
sample 17.5
transparent 17
bottle 16.5
bucket 16.4
instrument 15.8
discovery 15.6
tool 13.7
industry 13.7
alcohol 13.5
drink 13.3
punch 13
can 12.7
milk can 12.7
beakers 11.9
pharmacology 11.8
pharmaceutical 11.7
clinical 11.7
group 11.3
negative 10.8
biochemistry 10.8
analysis 10.7
examination 10.7
objects 10.4
water jug 10.3
jug 10.1
element 9.9
apparatus 9.8
microbiology 9.8
mixed drink 9.8
technology 9.6
object 9.5
solution 9.5
film 8.9
laboratory equipment 8.9
specimens 8.9
sterilize 8.9
test tube 8.9
specimen 8.9
sterile 8.8
holder 8.8
colors 8.8
technician 8.8
gown 8.8
scale 8.7
education 8.7
jar 8.6
cold 8.6
drops 8.5
clothing 8.4
decoration 8
researcher 7.9
drug 7.8
table 7.8
assistant 7.8
health 7.6
beverage 7.5
clean 7.5
closeup 7.4
light 7.3
plastic 7.3
empty 7.3
celebration 7.2
ice 7

Google
created on 2021-12-14

Font 80.2
Event 70
Art 69.4
Suit 64.4
Crew 64.3
Stock photography 62.3
Room 62.3
History 61.4
Visual arts 59.7
Team 59.1
Monochrome photography 50.6
Monochrome 50.1

Microsoft
created on 2021-12-14

text 99
window 98.5
posing 94.3
clothing 91.8
person 90.1
group 80.4
people 70.6
man 66.6
footwear 64.4
old 62.5

Face analysis

Amazon

Google

AWS Rekognition

Age 45-63
Gender Female, 93.9%
Sad 50.3%
Calm 34.2%
Happy 12.2%
Angry 1.8%
Confused 0.9%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 34-50
Gender Male, 63.9%
Calm 51.6%
Happy 44.5%
Sad 2.4%
Confused 0.9%
Angry 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 24-38
Gender Male, 69.5%
Happy 72%
Sad 14.8%
Calm 12.7%
Confused 0.3%
Angry 0.1%
Surprised 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 22-34
Gender Male, 67.8%
Sad 60.1%
Calm 23.2%
Fear 7.5%
Happy 5.8%
Angry 1.4%
Confused 0.8%
Surprised 0.7%
Disgusted 0.5%

AWS Rekognition

Age 16-28
Gender Female, 84.5%
Calm 52.1%
Happy 43.8%
Sad 2.9%
Angry 0.7%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 37-55
Gender Female, 96%
Calm 87.4%
Happy 10.6%
Sad 1.5%
Angry 0.2%
Confused 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 23-35
Gender Female, 53.4%
Calm 43.7%
Happy 36.3%
Sad 15.3%
Confused 2.6%
Angry 0.8%
Surprised 0.7%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 19-31
Gender Female, 56%
Calm 93.2%
Surprised 2.2%
Happy 1.9%
Sad 1.4%
Fear 0.4%
Angry 0.4%
Confused 0.3%
Disgusted 0.2%

AWS Rekognition

Age 33-49
Gender Female, 67.3%
Sad 68.7%
Happy 17.3%
Calm 11.3%
Angry 0.9%
Confused 0.8%
Disgusted 0.5%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 18-30
Gender Male, 57.5%
Calm 47.1%
Happy 35.8%
Sad 13.5%
Angry 1.2%
Confused 0.9%
Surprised 0.6%
Fear 0.6%
Disgusted 0.3%

AWS Rekognition

Age 25-39
Gender Male, 91.6%
Calm 91%
Sad 4.3%
Surprised 2%
Confused 2%
Angry 0.4%
Happy 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 17-29
Gender Female, 63.8%
Happy 61.2%
Calm 25.3%
Sad 7.6%
Angry 2.2%
Surprised 1.8%
Confused 1%
Fear 0.5%
Disgusted 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 98.7%
Chair 77.1%
Chess 71.6%

Captions

Microsoft

a group of people posing for a photo 96.3%
a group of people posing for the camera 96.2%
a group of people posing for a picture 96.1%

Text analysis

Amazon

Home
Parties
Tupperware Home Parties
Tupperware

Google

Tipperware
Home
forlies
Tipperware Home forlies .....
.....