Human Generated Data

Title

Untitled (four girls on skiis)
Date

c. 1940
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7475
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (four girls on skiis)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1940

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.3
Person 99.1
Person 98.7
Sport 92.1
Sports 92.1
Clothing 87.2
Apparel 87.2
People 82.6
Outdoors 68.9
Nature 67.7
Cricket 67.1
Stilts 64.9
Pillar 64.9
Building 64.9
Architecture 64.9
Column 64.9
Pants 61.6
Croquet 59.8
Piste 58.8
Snow 58.8
Sleeve 56.8
Stick 56.4
Portrait 56.3
Photography 56.3
Face 56.3
Photo 56.3
Shorts 55.9

Imagga
created on 2022-01-08

person 34.5
people 33.4
silhouette 31.4
man 28.9
male 27.6
crowd 24.9
crutch 24.8
team 24.2
businessman 23.8
business 20.6
symbol 20.2
nighttime 19.6
job 19.4
staff 19.3
businesswoman 19.1
cheering 18.6
flag 18.6
teamwork 18.5
audience 18.5
stadium 18.5
patriotic 18.2
nation 18
lights 17.6
vibrant 17.5
group 16.9
player 16.6
stick 16.4
bright 16.4
design 16.3
work 15.7
icon 15
sport 14.9
vivid 14.9
boss 14.3
occupation 13.7
sexy 13.6
adult 13.4
presentation 13
president 12.8
black 12.6
men 12
supporters 11.8
speech 11.7
leader 11.6
golfer 11.5
blackboard 11.3
couple 11.3
stage 11.2
event 11.1
happy 10
active 10
together 9.6
walking 9.5
lifestyle 9.4
suit 9.2
platform 9
activity 9
success 8.8
love 8.7
professional 8.5
training 8.3
sign 8.3
body 8
women 7.9
clothing 7.9
sea 7.8
portrait 7.8
skill 7.7
sky 7.6
hand 7.6
human 7.5
document 7.4
water 7.3
competition 7.3
exercise 7.3
art 7.2
sunset 7.2
contestant 7.1
happiness 7
travel 7

Google
created on 2022-01-08

Headgear 81.8
Art 74.7
Vintage clothing 72.2
Font 70.8
Monochrome photography 69.2
Monochrome 68.1
Visual arts 67.4
Uniform 65.1
Room 64.1
Stock photography 63.6
Illustration 61.5
History 60.6
Team 60.4
Rectangle 59.2
Fashion design 59.2
Personal protective equipment 58
Family 51.1

Microsoft
created on 2022-01-08

text 99.9
wall 97.5
posing 96.3
old 95.4
clothing 92.9
standing 91.2
man 90.7
person 87.9
black 84
woman 80
dress 78.4
black and white 68
white 65.9
vintage 34.9

Face analysis

Amazon

Google

AWS Rekognition

Age 42-50
Gender Male, 88.4%
Calm 66.6%
Happy 29.4%
Surprised 1.4%
Disgusted 1.2%
Confused 0.5%
Sad 0.4%
Angry 0.3%
Fear 0.2%

AWS Rekognition

Age 43-51
Gender Female, 91.7%
Happy 99.4%
Calm 0.2%
Sad 0.1%
Surprised 0.1%
Angry 0%
Confused 0%
Disgusted 0%
Fear 0%

AWS Rekognition

Age 37-45
Gender Female, 56.5%
Happy 93.5%
Calm 3.2%
Sad 1.4%
Confused 0.6%
Surprised 0.6%
Angry 0.3%
Disgusted 0.3%
Fear 0.1%

AWS Rekognition

Age 39-47
Gender Female, 95.9%
Calm 61.7%
Happy 15.5%
Sad 15.2%
Surprised 3.3%
Confused 1.6%
Fear 1%
Angry 0.9%
Disgusted 0.8%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%

Captions

Microsoft

a vintage photo of a group of people posing for the camera 97%
a vintage photo of a group of people posing for a picture 96.9%
a group of people posing for a photo 96.8%