Human Generated Data

Title

Untitled (young adults sitting against balustrade of stage)

Date

1940

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.5670

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young adults sitting against balustrade of stage)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.6
Person 99.6
Person 99.4
Person 98.7
Person 98.3
Person 96.7
Person 95.3
Person 94.7
Meal 82.3
Food 82.3
People 80.4
Crowd 78.7
Accessories 78.4
Sunglasses 78.4
Accessory 78.4
Clothing 77.8
Apparel 77.8
Face 76.1
Person 74.7
Female 74.2
Person 69.9
Person 68.4
Girl 65
Text 61
Leisure Activities 58.2
Bed 58.1
Furniture 58.1
Drawing 57.8
Art 57.8
Person 42.7

Imagga
created on 2021-12-15

daily 41.5
man 24.9
male 20.6
person 18.4
people 18.4
newspaper 17.5
silhouette 17.4
men 17.2
business 17
winter 16.2
snow 15.6
businessman 15
product 14.8
sport 14.1
grunge 13.6
success 12.9
creation 12.3
sign 12
black 11.4
drawing 11
work 11
adult 10.8
cold 10.3
art 10.3
graphic 10.2
design 10.1
symbol 10.1
brass 10
team 9.9
wind instrument 9.8
group 9.7
life 9.5
finance 9.3
active 9.1
sky 8.9
lifestyle 8.7
ice 8.6
chart 8.6
poster 8.5
manager 8.4
hand 8.4
sketch 8.1
activity 8.1
office 8
idea 8
travel 7.7
frost 7.7
old 7.7
outdoor 7.6
musical instrument 7.6
arrow 7.5
pattern 7.5
fun 7.5
retro 7.4
dirty 7.2
cool 7.1
job 7.1
copy 7.1
player 7.1

Google
created on 2021-12-15

Hat 87.5
Font 78.5
Art 73.1
Sun hat 66.3
Event 64.4
Illustration 62.2
Musical instrument 61.3
History 61.1
Monochrome 60.1
Vintage clothing 57.8
Suit 55.2
Room 54.5
Paper product 53.3
Team 53.2
Crew 53.2
Monochrome photography 52
Visual arts 51.2

Microsoft
created on 2021-12-15

text 99.4
drawing 96.8
outdoor 93.2
person 92.7
clothing 89.8
sketch 84.9
man 72.8
cartoon 64.1
snow 63

Face analysis

Amazon

Google

AWS Rekognition

Age 16-28
Gender Male, 95.8%
Calm 57.2%
Happy 33%
Sad 7.3%
Surprised 0.9%
Angry 0.5%
Confused 0.4%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 28-44
Gender Female, 77.1%
Angry 74.9%
Calm 12.2%
Surprised 9.2%
Happy 2.7%
Sad 0.4%
Fear 0.3%
Disgusted 0.1%
Confused 0.1%

AWS Rekognition

Age 30-46
Gender Female, 78.9%
Calm 93.3%
Happy 3.1%
Surprised 1.8%
Sad 0.8%
Angry 0.5%
Confused 0.3%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 23-35
Gender Female, 54.1%
Calm 71.5%
Surprised 19.1%
Sad 4.7%
Angry 1.9%
Confused 1.1%
Disgusted 1%
Happy 0.5%
Fear 0.2%

AWS Rekognition

Age 50-68
Gender Male, 71.7%
Sad 51%
Calm 44.9%
Confused 2.6%
Angry 0.5%
Surprised 0.4%
Fear 0.3%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 26-42
Gender Male, 76.9%
Calm 90.6%
Sad 7.3%
Angry 1.3%
Confused 0.3%
Surprised 0.3%
Happy 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 19-31
Gender Male, 53.5%
Calm 70.8%
Sad 20.5%
Angry 4.8%
Happy 1.4%
Confused 1.2%
Fear 0.7%
Surprised 0.5%
Disgusted 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Sunglasses 78.4%

Captions

Microsoft

a group of people posing for a photo 88.1%
a group of people posing for the camera 88%
a group of people posing for a picture 87.9%

Text analysis

Amazon

8.
1389 8.
1389
13898.
13898
BELF
- ИАМТСАЗ

Google

NAGON-
YT3RA2
1389 8 13898. NAGON- YT3RA2 NAMIC BEE
8
BEE
13898.
1389
NAMIC