Human Generated Data

Title

Untitled (three couples dancing)
Date

c. 1950
People

Artist: Joseph Janney Steinmetz, American 1905 - 1985
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10590
Copyright

© Estate of Joseph Janney Steinmetz

Human Generated Data

Title

Untitled (three couples dancing)

People

Artist: Joseph Janney Steinmetz, American 1905 - 1985

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-09

Human 99.5
Person 99.5
Apparel 99.2
Clothing 99.2
Person 99.1
Person 97.3
Person 97.1
Person 97
Indoors 90.1
Room 90.1
Dress 87.9
Female 87.4
Home Decor 87.1
Overcoat 85.8
Suit 85.8
Coat 85.8
People 79.6
Fashion 72.2
Robe 72.2
Woman 72.2
Gown 67.2
Leisure Activities 66.7
Dance Pose 66.7
Girl 63.8
Evening Dress 60.8
Wedding 59.5
Dance 59.4
Performer 58.6
Furniture 58.6
Chair 57.3
Tuxedo 56.9
Wedding Gown 56
Accessories 55.9
Accessory 55.9
Tie 55.9
Tie 50.4

Imagga
created on 2022-01-09

teacher 38.3
man 36.3
person 34.5
male 33.3
businessman 32.6
people 31.8
business 31
professional 28.8
adult 28.3
executive 27.4
educator 25.1
office 24.7
corporate 24
men 24
women 19.8
meeting 18.8
group 18.5
team 17.9
room 17.4
couple 16.5
black 15.7
suit 15.3
job 15
happy 15
work 14.9
modern 14.7
planner 14.4
portrait 14.2
indoors 13.2
teamwork 13
indoor 12.8
businesswoman 12.7
communication 12.6
handsome 12.5
senior 12.2
casual 11.9
hand 11.4
career 11.4
entrepreneur 11.3
computer 11.2
looking 11.2
manager 11.2
two 11
board 10.8
silhouette 10.8
boss 10.5
businesspeople 10.4
standing 10.4
desk 10.4
education 10.4
home 10.4
youth 10.2
smiling 10.1
laptop 10
jacket 9.7
success 9.7
classroom 9.6
hands 9.6
chair 9.5
building 9.5
smile 9.3
human 9
interior 8.8
boy 8.7
corporation 8.7
love 8.7
leader 8.7
lifestyle 8.7
happiness 8.6
tie 8.5
attractive 8.4
worker 8.3
occupation 8.2
employee 8.2
window 8
night 8
together 7.9
old 7.7
elderly 7.7
formal 7.6
ethnic 7.6
finance 7.6
fashion 7.5
secretary 7.4
mature 7.4
student 7.4
guy 7.3
back 7.3
clothing 7.2
hair 7.1
day 7.1
blackboard 7.1

Google
created on 2022-01-09

Dress 89.6
Black-and-white 85.8
Style 84
Musical instrument 82.5
Window 78.3
People 77.7
Monochrome photography 77
Monochrome 76.6
Suit 74.9
Snapshot 74.3
Vintage clothing 73.9
Chair 73.7
Event 73.4
Hat 71.4
Room 71.1
Classic 70.3
Music 69.6
Stock photography 64.8
Formal wear 64.2
Conversation 63.7

Microsoft
created on 2022-01-09

person 99.9
text 99.6
standing 93.4
group 86.8
clothing 86.1
dress 85.8
wedding 71.7
woman 69.3
posing 63.7
man 60.7
wedding dress 54.8

Face analysis

Amazon

Google

AWS Rekognition

Age 54-62
Gender Male, 95.1%
Happy 31.1%
Sad 26%
Calm 18.6%
Surprised 8.3%
Confused 6.8%
Disgusted 4.3%
Angry 2.8%
Fear 2.1%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Fear 72%
Surprised 11.1%
Confused 4.9%
Sad 4.5%
Happy 2.1%
Disgusted 1.9%
Calm 1.8%
Angry 1.7%

AWS Rekognition

Age 48-56
Gender Male, 99.8%
Confused 72.7%
Sad 16.5%
Surprised 2.7%
Calm 2.6%
Disgusted 2.5%
Angry 1.1%
Happy 1.1%
Fear 0.7%

AWS Rekognition

Age 27-37
Gender Female, 57.2%
Calm 99.7%
Surprised 0.1%
Happy 0.1%
Sad 0.1%
Fear 0%
Disgusted 0%
Confused 0%
Angry 0%

AWS Rekognition

Age 30-40
Gender Female, 95%
Happy 57.9%
Calm 28.3%
Sad 5.3%
Surprised 2.9%
Confused 2.6%
Angry 1.3%
Fear 0.9%
Disgusted 0.9%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Chair 57.3%
Tie 55.9%

Captions

Microsoft

a group of people posing for the camera 94.5%
a group of people standing in a room 94.4%
a group of people posing for a picture 94.3%

Text analysis

Amazon

8S
25905.
YT37A2-XAGOX

Google

28905.
25905.
28905. 25905.