Human Generated Data

Title

Untitled (soldiers standing in front of Army/Navy banner)

Date

c. 1950

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7080

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (soldiers standing in front of Army/Navy banner)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.3
Human 99.3
Person 96.2
Person 92.3
Person 89.1
Person 88.9
Advertisement 84.1
Text 83.5
Person 81.1
Person 77.2
Collage 70.4
Paper 66.9
Person 66.6
Shop 65.5
Person 65.3
Money 63.8
Flyer 58.6
Brochure 58.6
Poster 58.2
Person 58.1
Plot 57.8
Diagram 57.8
Plan 57.8
Apparel 57.3
Clothing 57.3
Shorts 55.7

Imagga
created on 2021-12-15

facility 41.2
map 40.1
drawing 37.5
representation 31
sketch 30.2
sewage system 29.6
design 29.3
art 20.3
paper 19.5
plan 18.9
symbol 18.9
business 18.9
construction 18.8
icon 17.4
architecture 17.2
set 17
pattern 14.4
sign 14.3
grunge 13.6
old 13.3
industry 12.8
blueprint 12.7
retro 12.3
house 11.7
cartoon 11.6
architect 11.6
element 11.6
equipment 11.4
building 11.1
frame 11
decorative 10.9
painting 10.9
silhouette 10.8
engineering 10.5
technology 10.4
graphic 10.2
clip art 10.2
vintage 9.9
currency 9.9
travel 9.9
drafting 9.9
ruler 9.8
structure 9.7
shape 9.6
pencil 9.6
engineer 9.6
black 9.6
decoration 9.5
floor 9.3
city 9.2
world 8.9
office 8.8
computer 8.8
geography 8.7
money 8.5
print 8.5
finance 8.5
modern 8.4
dollar 8.4
antique 8.4
style 8.2
contractor 7.8
designer 7.7
gymnasium 7.7
project 7.7
diagram 7.7
web 7.6
pen 7.6
course 7.5
ideas 7.5
body of water 7.5
document 7.4
earth 7.3
golf course 7.3
border 7.2
dirty 7.2
collection 7.2
work 7.1

Google
created on 2021-12-15

Photograph 94.1
Product 90.7
Sleeve 87.2
Style 83.8
Black-and-white 83.6
Font 83.5
Rectangle 76.6
Monochrome photography 74.4
Snapshot 74.3
Monochrome 73.8
Pattern 72.5
Design 68.3
Advertising 66.7
Stock photography 64.3
Brand 63.6
Room 62.5
Graphics 56.9
T-shirt 55.8
Logo 55.6
Visual arts 51.3

Microsoft
created on 2021-12-15

text 97.1
drawing 95.7
indoor 90.3
sketch 85.1
black and white 77.3

Face analysis

Amazon

Google

AWS Rekognition

Age 36-54
Gender Male, 69.1%
Calm 96.3%
Happy 1.9%
Sad 1%
Surprised 0.5%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Disgusted 0.1%

AWS Rekognition

Age 53-71
Gender Male, 52.7%
Sad 58.2%
Calm 22.7%
Disgusted 4.9%
Angry 3.8%
Surprised 3.5%
Fear 2.9%
Happy 2.8%
Confused 1.1%

AWS Rekognition

Age 23-37
Gender Male, 57.9%
Calm 51.2%
Sad 43.1%
Happy 2%
Confused 1.6%
Disgusted 0.7%
Angry 0.6%
Surprised 0.5%
Fear 0.3%

AWS Rekognition

Age 51-69
Gender Male, 95.4%
Calm 74.3%
Confused 8%
Sad 7%
Angry 3.3%
Surprised 2.9%
Disgusted 1.8%
Fear 1.5%
Happy 1.2%

AWS Rekognition

Age 11-21
Gender Female, 63.6%
Confused 82.9%
Calm 5.5%
Sad 4.3%
Surprised 2.6%
Disgusted 2.6%
Happy 1.5%
Fear 0.3%
Angry 0.3%

AWS Rekognition

Age 20-32
Gender Male, 97.5%
Calm 97.5%
Happy 1.7%
Sad 0.3%
Surprised 0.2%
Confused 0.1%
Disgusted 0.1%
Angry 0.1%
Fear 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Poster 58.2%

Captions

Microsoft

an old photo of a person 37.1%
old photo of a person 36%
an old photo of a person 35.9%

Text analysis

Amazon

ARMY
Ford
E
20870.
2087.
NAVI
MUZ

Google

20870 . Ford ARMY AVK. NAVT 20870 2087•.
ARMY
20870
.
Ford
2087•.
AVK.
NAVT