Human Generated Data

Title

Untitled (young children in a line following instructor)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7041
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (young children in a line following instructor)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Person 99.7
Human 99.7
Person 99.7
Person 99.5
Person 98.8
Apparel 98.7
Clothing 98.7
Person 98.4
Shorts 97.9
Person 95.1
Person 95
Person 94.9
Person 94.1
Person 92
Person 89.8
Person 88.7
Shoe 86.3
Footwear 86.3
Crowd 85.6
Pedestrian 75.9
People 75
Person 72.3
Shoe 71.9
Person 69
Shoe 68.9
Shoe 68.8
Female 63.8
Parade 59.6
Asphalt 56.9
Tarmac 56.9
Person 55.1
Shoe 53.6

Imagga
created on 2021-12-15

blackboard 51.3
business 21.9
symbol 20.2
art 18.1
sign 18.1
silhouette 17.4
grunge 17
design 16.3
gymnasium 16.3
graphic 16.1
flag 14.1
athletic facility 13.1
technology 12.6
night 12.4
ripple 12.4
people 12.3
party 12
men 12
facility 11.8
world 11.7
city 11.6
urban 11.4
drawing 11.2
male 10.6
hand 10.6
dance 10.4
black 10.2
event 10.2
person 10.1
waving 9.7
businessman 9.7
structure 9.7
group 9.7
website 9.4
architecture 9.4
water 9.3
web 9.3
clip 9.3
finance 9.3
sketch 9.1
retro 9
tower 9
style 8.9
domain 8.9
information 8.9
rippling 8.8
spectator 8.8
tracing 8.8
building 8.7
patriotism 8.7
search 8.7
wavy 8.7
navigation 8.7
scene 8.7
crowd 8.6
patriotic 8.6
state 8.6
skyline 8.6
space 8.5
nation 8.5
winter 8.5
fabric 8.5
site 8.4
commerce 8.4
old 8.4
man 8.3
sky 8.3
national 8.2
history 8
light 8
country 7.9
users 7.9
homepage 7.9
e commerce 7.8
modern 7.7
construction 7.7
downtown 7.7
wide 7.7
cityscape 7.6
map 7.4
ice 7.3
speed 7.3
backgrounds 7.3
success 7.2
idea 7.1

Google
created on 2021-12-15

Black 89.5
Gesture 85.3
Font 82.8
Art 77.8
Event 72.8
Monochrome photography 71.7
Monochrome 71.6
Crew 64.3
Uniform 63.8
Stock photography 62.6
Visual arts 61.8
Team 60
Crowd 54.2
Illustration 53.8
Pattern 52.7
Photo caption 50.1
Public event 50.1

Microsoft
created on 2021-12-15

text 99.1
person 98
outdoor 93
posing 89.6
clothing 87.9
dance 83.6
footwear 80.3
player 80
black and white 78.9
old 78.2
black 70.6
white 62.6
group 55.7
team 42.3
vintage 29

Face analysis

Amazon

Google

AWS Rekognition

Age 46-64
Gender Female, 88.2%
Calm 67.2%
Sad 23.1%
Confused 3.7%
Happy 3.1%
Fear 1.3%
Surprised 1%
Angry 0.3%
Disgusted 0.2%

AWS Rekognition

Age 43-61
Gender Female, 62.8%
Calm 98.8%
Sad 0.7%
Happy 0.1%
Confused 0.1%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 48-66
Gender Male, 62.7%
Calm 64.9%
Sad 34.3%
Confused 0.6%
Angry 0.1%
Surprised 0.1%
Happy 0%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 9-19
Gender Male, 74.1%
Calm 58.9%
Happy 12.9%
Sad 9.4%
Fear 7.4%
Confused 5.2%
Angry 3.1%
Surprised 2.8%
Disgusted 0.3%

AWS Rekognition

Age 28-44
Gender Female, 64.5%
Calm 98.2%
Sad 1.3%
Disgusted 0.1%
Happy 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 41-59
Gender Male, 97%
Sad 96.6%
Calm 2.8%
Fear 0.2%
Confused 0.2%
Angry 0.1%
Happy 0.1%
Surprised 0%
Disgusted 0%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Shoe 86.3%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 92.4%
a vintage photo of a group of people posing for a picture 92.3%
a group of people posing for a photo 92.2%

Text analysis

Amazon

22418
EVECTA

Google

22418
22418