Human Generated Data

Title

Untitled (couples square dancing near stairs accompanied by fiddle and guitar player)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.7068
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (couples square dancing near stairs accompanied by fiddle and guitar player)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2021-12-15

Human 99.8
Person 99.8
Person 99.7
Person 99.5
Person 99.3
Person 97.8
Person 97.7
Person 97.4
Person 97.3
Person 96.9
Person 92.9
Leisure Activities 91.5
Musical Instrument 91.5
Guitar 91.5
Person 91.2
Person 90.3
Person 90
Clinic 89.5
Footwear 88.9
Shoe 88.9
Apparel 88.9
Clothing 88.9
Person 84
Person 83.4
People 81
Person 80.8
Room 79.4
Indoors 79.4
Shoe 75
Crowd 70.5
Shorts 70.1
Person 65.4
Text 62.9
Operating Theatre 58.8
Hospital 58.8
Female 56.6
Photo 55
Photography 55
Person 49.3
Person 45.3

Imagga
created on 2021-12-15

brass 44.6
cornet 36.6
wind instrument 35.6
people 32.9
silhouette 28.1
man 24.8
person 24.4
musical instrument 23.5
male 22
men 19.7
business 16.4
businessman 15.9
team 15.2
group 14.5
human 14.2
sport 14
adult 13.7
player 13.4
black 13.2
professional 11.7
art 11.5
symbol 11.4
design 11.2
nurse 11.2
party 11.2
event 11.1
women 11.1
grunge 11.1
graphic 10.9
work 10.2
crowd 9.6
health 9
office 8.8
diagram 8.6
film 8.4
sign 8.3
active 8.2
one 8.2
drawing 8.1
success 8
life 8
job 8
working 7.9
medical 7.9
medicine 7.9
vibrant 7.9
bright 7.9
standing 7.8
portrait 7.8
reflection 7.7
chart 7.6
photographer 7.6
fashion 7.5
teamwork 7.4
style 7.4
light 7.3
competition 7.3
backgrounds 7.3
painting 7.2
suit 7.2
equipment 7.2
worker 7.2
love 7.1

Google
created on 2021-12-15

Style 83.8
Black-and-white 83.3
Font 82.4
Art 76.3
Monochrome photography 74.5
Monochrome 72.7
Event 71.7
Vintage clothing 71.7
Room 67.6
Visual arts 64.8
Rectangle 64.7
Pattern 64.5
History 62.2
Stock photography 61.7
Team 60.8
Fun 58.8
Classic 55.6
Photographic paper 54.3
Hat 53.1
Crew 52.6

Microsoft
created on 2021-12-15

text 98.5
person 97
posing 95.5
clothing 92.5
man 82.3
group 63.4
woman 61.7
dance 55
old 40.7

Face analysis

Amazon

Google

AWS Rekognition

Age 25-39
Gender Male, 84.9%
Calm 65.6%
Happy 30.2%
Sad 2.3%
Confused 0.8%
Surprised 0.4%
Angry 0.3%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 37-55
Gender Male, 94.6%
Calm 83.6%
Happy 8.9%
Sad 5.4%
Confused 1%
Surprised 0.5%
Angry 0.2%
Disgusted 0.2%
Fear 0.2%

AWS Rekognition

Age 24-38
Gender Male, 92.5%
Calm 46.9%
Happy 40.5%
Sad 10.8%
Confused 0.8%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 46-64
Gender Female, 52.7%
Calm 82%
Happy 10.7%
Sad 3.3%
Confused 1.8%
Angry 0.9%
Surprised 0.5%
Fear 0.5%
Disgusted 0.3%

AWS Rekognition

Age 32-48
Gender Female, 88.5%
Calm 64.2%
Sad 26.7%
Happy 5.6%
Angry 1.6%
Confused 0.9%
Fear 0.4%
Surprised 0.4%
Disgusted 0.3%

AWS Rekognition

Age 49-67
Gender Male, 63.5%
Happy 47.8%
Calm 36.9%
Sad 10.6%
Angry 2.2%
Disgusted 1.3%
Confused 0.6%
Fear 0.4%
Surprised 0.2%

AWS Rekognition

Age 22-34
Gender Female, 95.9%
Happy 64.7%
Sad 16.1%
Fear 11%
Calm 5%
Surprised 1.7%
Angry 0.8%
Confused 0.6%
Disgusted 0.2%

AWS Rekognition

Age 50-68
Gender Male, 80.9%
Sad 39.7%
Calm 36.7%
Happy 21%
Confused 1.3%
Angry 0.6%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 17-29
Gender Female, 98.1%
Sad 82.1%
Calm 7.6%
Happy 7.4%
Fear 1.7%
Confused 0.5%
Surprised 0.3%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 28-44
Gender Female, 82.3%
Happy 74.4%
Calm 21.3%
Surprised 1.9%
Confused 1%
Sad 0.5%
Angry 0.5%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 11-21
Gender Female, 59.3%
Happy 54.6%
Calm 35%
Sad 7.9%
Confused 1.1%
Angry 0.7%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 17-29
Gender Female, 62.1%
Sad 53.5%
Happy 34.2%
Calm 8.7%
Fear 1.8%
Confused 0.7%
Angry 0.6%
Surprised 0.4%
Disgusted 0.1%

AWS Rekognition

Age 50-68
Gender Male, 56.7%
Calm 77.9%
Happy 19.8%
Disgusted 1.1%
Surprised 0.5%
Sad 0.3%
Angry 0.2%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 27-43
Gender Male, 61.1%
Happy 65.6%
Calm 21.1%
Sad 11.3%
Confused 1.2%
Surprised 0.4%
Angry 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 44-62
Gender Female, 56%
Calm 95.7%
Sad 3%
Happy 0.5%
Confused 0.4%
Angry 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 8-18
Gender Female, 53.6%
Calm 70.5%
Happy 14.1%
Sad 13.5%
Angry 1%
Fear 0.5%
Confused 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 50-68
Gender Male, 80%
Calm 97.2%
Sad 1.7%
Happy 0.7%
Angry 0.1%
Surprised 0.1%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 49-67
Gender Male, 58.7%
Calm 89.7%
Happy 4.9%
Sad 2.3%
Fear 1.2%
Confused 0.7%
Surprised 0.6%
Angry 0.5%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Guitar 91.5%
Shoe 88.9%

Captions

Microsoft

a group of people posing for a photo 86.6%
a group of people posing for the camera 86.5%
a group of people posing for a picture 86.4%

Text analysis

Amazon

KEY,
SIESTA
J.
34
J. J. STEINMETZ, SIESTA KEY, SARASOTA,-FLA.
STEINMETZ,
22184.
SARASOTA,-FLA.
لاموملا

Google

STEINMETZ,
SARASOTA,
22184. J. J. STEINMETZ, SIESTA KEY, SARASOTA, FLA.
22184.
J.
KEY,
FLA.
SIESTA