Human Generated Data

Title

Untitled (three young children dressed up for skit)
Date

c. 1945
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7704
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three young children dressed up for skit)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1945

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Person 99.4
Human 99.4
Person 99.4
Clothing 99.2
Apparel 99.2
Person 98.3
Person 94.2
Text 93.6
Person 89.1
Person 78.3
Dress 76.4
Shorts 72.9
Sleeve 68.5
Suit 58.8
Overcoat 58.8
Coat 58.8
Crowd 58.5

Imagga
created on 2022-01-09

man 30.3
people 28.4
wind instrument 26.1
person 25
male 24.9
businessman 24.7
business 20.6
adult 20
professional 18.5
musical instrument 18.5
men 18
brass 15.7
happy 15.7
portrait 14.2
life 14
suit 13.5
job 13.3
success 12.9
looking 12.8
world 12.4
teacher 12.4
woodwind 11.4
dress 10.8
flute 10.7
pretty 10.5
attractive 10.5
executive 10.5
boy 10.4
corporate 10.3
lifestyle 10.1
indoor 10
face 9.9
hand 9.9
human 9.7
group 9.7
black 9.6
career 9.5
meeting 9.4
youth 9.4
casual 9.3
fashion 9
lady 8.9
handsome 8.9
worker 8.9
to 8.8
standing 8.7
love 8.7
work 8.6
employee 8.6
wall 8.6
musician 8.5
tie 8.5
kin 8.5
room 8.4
holding 8.3
blackboard 8.2
singer 8.1
team 8.1
office 8
financial 8
smiling 8
indoors 7.9
performer 7.8
couple 7.8
educator 7.8
boss 7.6
cornet 7.6
finance 7.6
sign 7.5
manager 7.4
groom 7.3
color 7.2
smile 7.1
women 7.1
together 7

Google
created on 2022-01-09

Black-and-white 84.7
Style 84
Font 81.8
Adaptation 79.2
Tent 79
Art 78.8
Monochrome 75.3
Monochrome photography 74.3
Vintage clothing 70.8
Poster 67.5
Event 67.2
Visual arts 66.9
Room 65.2
Suit 65
History 62.7
Advertising 62.4
Musical instrument 58.9
Pattern 58.6
Photographic paper 57.2
Illustration 57

Microsoft
created on 2022-01-09

text 98.1
clothing 94
person 92.8
outdoor 91
posing 90.2
drawing 89.2
man 68.6
black and white 66.3
sketch 59.8
old 56.4
woman 53.5

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 97.2%
Happy 97.2%
Surprised 1.4%
Calm 0.5%
Sad 0.4%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 28-38
Gender Male, 99.2%
Surprised 55.6%
Happy 14.7%
Sad 13.4%
Calm 6.7%
Confused 3.9%
Disgusted 2.7%
Angry 1.7%
Fear 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%

Captions

Microsoft

a group of people posing for a photo 89.4%
a group of people posing for the camera 89.3%
a group of people posing for a picture 89.2%

Text analysis

Amazon

USA
MIDGETS
IN USA
SMALLEST
IN
THEIR
SIZE
OF THEIR SIZE
OF
os
YT37A2-YAOOX

Google

SMALLEST MIDGETS (F THEIR SIZE IN USA YT37A2-YAGO>
SMALLEST
MIDGETS
(F
THEIR
SIZE
IN
USA
YT37A2-YAGO>