Human Generated Data

Title

Untitled (women at Tupperware party)

Date

1958

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.4625

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (women at Tupperware party)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1958

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Human 98.7
Person 98.7
Person 98.4
Person 97.1
Person 96.2
Person 95.7
Person 93.7
Person 93
Person 92.7
Person 91.9
Person 89.5
Person 86
Person 84.2
Game 81.9
Chess 81.9
People 74.2
Chair 74.1
Furniture 74.1
Crowd 68.4
Person 66.4
Pottery 65.8
Cup 57.7
Coffee Cup 57.7
Person 51.5

Imagga
created on 2021-12-14

negative 48.4
beaker 40.9
glass 40.4
film 39.3
container 36.4
chemical 32.8
laboratory 31.8
liquid 31.3
biology 31.3
equipment 31.1
chemistry 30.9
research 30.4
photographic paper 30.4
experiment 30.2
flask 28.5
science 28.5
medical 28.2
development 26.7
lab 26.2
glassware 25.5
pharmacy 23.3
water 22.7
aqua 21.9
acid 21.6
scientific 21.3
glasses 21.3
test 21.2
h2o 20.6
biotechnology 20.6
photographic equipment 20.3
tube 20.3
fluid 19.4
medicine 19.4
discovery 18.5
sample 18.5
measure 18
transparent 17.9
scientist 16.6
drink 15
instrument 14.9
cup 14.2
bottle 13.8
tool 13.6
pawn 13.4
solution 13.3
group 12.9
beakers 12.8
industry 12.8
chess 12.8
clinical 12.7
vessel 12.5
objects 12.2
jar 12
technology 11.9
pharmacology 11.8
pharmaceutical 11.7
apparatus 10.8
holder 10.8
element 10.7
analysis 10.7
examination 10.7
king 10.7
drops 10.4
business 10.3
specimens 9.9
sterilize 9.9
specimen 9.9
ice 9.9
biochemistry 9.9
sterile 9.8
gown 9.8
empty 9.7
colors 9.7
strategy 9.7
scale 9.7
table 9.5
cold 9.5
symbol 9.4
wagon 9.3
test tube 8.9
drug 8.8
clear 8.7
education 8.7
set 8.5
health 8.3
plastic 8.3
game 8
decoration 8
laboratory equipment 7.9
microbiology 7.9
design 7.9
analyzing 7.8
queen 7.8
technician 7.8
color 7.8
beverage 7.7
power 7.6
horizontal 7.5
clean 7.5
care 7.4
object 7.3
success 7.2
man 7.2
celebration 7.2
wheeled vehicle 7.1
art 7.1

Google
created on 2021-12-14

Organism 85.3
Font 80.5
Art 80.5
Event 70
Visual arts 67.3
Painting 66.9
Room 64.6
Illustration 61.6
Circle 55.9
Monochrome 55.8
Team 54.3
Picture frame 54.1
History 53.3
Monochrome photography 53.2
Photo caption 50.6

Microsoft
created on 2021-12-14

window 99.6
posing 98.6
text 96.4
group 89.3
clothing 84
person 81
people 74.9
old 67.2
man 63.9

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Female, 56.1%
Calm 57.8%
Sad 24.7%
Happy 14.7%
Disgusted 0.8%
Confused 0.7%
Angry 0.6%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 19-31
Gender Female, 51.8%
Calm 61.5%
Happy 30.5%
Sad 7.2%
Angry 0.3%
Confused 0.3%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 22-34
Gender Male, 81.8%
Sad 66.5%
Calm 24.4%
Happy 4.9%
Angry 1.4%
Confused 1.1%
Fear 0.9%
Surprised 0.4%
Disgusted 0.4%

AWS Rekognition

Age 23-37
Gender Male, 88.4%
Calm 88.3%
Sad 4%
Surprised 3.2%
Fear 1.7%
Happy 1.4%
Confused 0.6%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 14-26
Gender Male, 58.8%
Happy 90.3%
Calm 4.8%
Sad 4.3%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 31-47
Gender Female, 98%
Calm 87.3%
Happy 11.5%
Sad 0.9%
Confused 0.1%
Angry 0.1%
Surprised 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 26-40
Gender Male, 70.7%
Calm 94.2%
Happy 2.3%
Sad 2%
Confused 0.6%
Angry 0.6%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 27-43
Gender Female, 55.3%
Happy 80.9%
Calm 13.3%
Sad 3.3%
Confused 0.8%
Surprised 0.5%
Fear 0.5%
Angry 0.5%
Disgusted 0.2%

AWS Rekognition

Age 20-32
Gender Female, 84.1%
Happy 97.8%
Calm 1.4%
Sad 0.2%
Confused 0.2%
Surprised 0.1%
Angry 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 16-28
Gender Male, 54.1%
Calm 46.1%
Happy 36.8%
Sad 11.3%
Angry 2.4%
Confused 1.2%
Surprised 0.9%
Fear 0.9%
Disgusted 0.4%

AWS Rekognition

Age 22-34
Gender Female, 61.1%
Calm 50.6%
Happy 40.2%
Sad 3%
Surprised 2.8%
Angry 1.8%
Confused 0.8%
Fear 0.4%
Disgusted 0.4%

AWS Rekognition

Age 21-33
Gender Female, 64.5%
Calm 83.5%
Sad 9.8%
Happy 5.9%
Confused 0.3%
Angry 0.2%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 33-49
Gender Female, 54.1%
Calm 79.1%
Sad 11.9%
Happy 4.2%
Surprised 1.7%
Confused 1.5%
Angry 0.7%
Fear 0.7%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 98.7%
Chess 81.9%
Chair 74.1%

Captions

Microsoft

a group of people posing for a photo 96.6%
a vintage photo of a group of people posing for the camera 94.6%
a vintage photo of a group of people posing for a picture 94.5%

Text analysis

Amazon

Home
Tupperware Home Parties
Parties
Tupperware

Google

Tappermare Home forti ..... .
Tappermare
forti
.
Home
.....