Human Generated Data

Title

Untitled (children dancing in studio, Pinecrest School, Florida)

Date

c. 1955

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10776

Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (children dancing in studio, Pinecrest School, Florida)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1955

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-15

Person 99.2
Human 99.2
Person 98.7
Person 98.4
Person 97.7
Person 96
Clothing 96
Apparel 96
Shorts 94.6
Person 93.4
Floor 93.3
Person 90.7
Flooring 81.3
Person 75.3
Person 74.6
Indoors 73.8
Screen 72.5
Electronics 72.5
Silhouette 71.4
People 71.3
Display 67.3
Monitor 67.3
Person 66
Kid 63
Child 63
Room 63
Female 62.2
Leisure Activities 58.9
Person 57.9
Footwear 57.6
Shoe 57.6
Stage 57
Sleeve 56.5
Play 55.1

Imagga
created on 2022-01-15

people 33.5
person 29.9
sport 25
man 22.8
adult 19.3
male 19.1
city 19.1
motion 18
room 17.7
urban 17.5
planner 17.2
women 16.6
men 16.3
lifestyle 15.9
group 15.3
business 15.2
walking 15.1
professional 14.5
exercise 14.5
active 13.6
fitness 13.5
outdoors 13.4
silhouette 13.2
speed 12.8
move 12.5
interior 12.4
dancer 12.3
athlete 12
competition 11.9
indoor 11.9
transportation 11.7
teacher 11.6
crowd 11.5
travel 11.3
classroom 11.1
performer 11
work 11
rush 10.8
blurred 10.5
walk 10.5
health 10.4
floor 10.2
day 10.2
hall 10.2
commuter 9.9
recreation 9.9
activity 9.9
airport 9.8
human 9.7
portrait 9.7
life 9.7
boy 9.6
educator 9.5
scene 9.5
blur 9.3
ball 9.1
modern 9.1
summer 9
team 9
working 8.8
happy 8.8
station 8.7
light 8.7
train 8.7
casual 8.5
window 8.4
transport 8.2
vacation 8.2
office 8
businessman 7.9
indoors 7.9
world 7.9
hallway 7.9
subway 7.9
corridor 7.9
architecture 7.8
glass 7.8
sitting 7.7
run 7.7
fun 7.5
leisure 7.5
fit 7.4
inside 7.4
street 7.4
sunset 7.2
worker 7.1

Google
created on 2022-01-15

Microsoft
created on 2022-01-15

dance 97.3
clothing 93.4
person 93
footwear 82.7
text 81.8
woman 72.3
black and white 60.6
dress 50.8

Face analysis

Amazon

Google

AWS Rekognition

Age 35-43
Gender Female, 88.2%
Sad 80.3%
Calm 12.2%
Happy 2.7%
Angry 1%
Surprised 1%
Fear 1%
Confused 0.9%
Disgusted 0.8%

AWS Rekognition

Age 11-19
Gender Female, 98.5%
Happy 58.4%
Calm 35.3%
Sad 3.6%
Angry 1%
Confused 0.5%
Surprised 0.5%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 47-53
Gender Female, 93.5%
Happy 65.1%
Sad 14.5%
Calm 9.3%
Confused 6.4%
Surprised 1.7%
Angry 1.1%
Fear 0.9%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 99.2%
Shoe 57.6%

Captions

Microsoft

a group of people standing next to a window 88.3%
a group of people standing in front of a window 86.9%
a group of people standing in front of a building 86.8%

Text analysis

Amazon

56796.
MJ17--YT37A°2
NAGOX

Google

5679
6.
5679 6.