Human Generated Data

Title

Untitled (several people posing in elaborate "Masons" regalia)
Date

c. 1950
People

Artist: Jack Rodden Studio, American 1914 - 2016
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.13609

Human Generated Data

Title

Untitled (several people posing in elaborate "Masons" regalia)

People

Artist: Jack Rodden Studio, American 1914 - 2016

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-04

Human 99.4
Person 99.4
Person 99.4
Person 98.8
Person 98.7
Person 98.4
Person 98.4
Person 97.9
Person 97.6
Person 96.9
Person 96.9
Person 96.6
Person 95.5
Clothing 81.1
Coat 81.1
Suit 81.1
Overcoat 81.1
Apparel 81.1
Priest 74.9
Indoors 58.4
Room 55.6

Imagga
created on 2022-02-04

musical instrument 51.2
percussion instrument 45.9
marimba 36.3
man 34.3
male 32.6
people 29
person 26.9
business 25.5
brass 23.9
businessman 22.9
office 22.5
wind instrument 22.2
group 21.8
stage 21.6
table 20.8
adult 20.2
women 19.8
sitting 19.7
happy 19.4
meeting 18.8
smiling 18.1
men 18
indoors 16.7
teacher 15.8
room 15.8
work 14.9
corporate 14.6
professional 14.6
team 14.3
chair 14.2
worker 14.1
couple 13.9
platform 13.6
waiter 13.5
desk 13.2
executive 13.1
smile 12.8
businesswoman 12.7
conference 12.7
job 12.4
vibraphone 12.1
manager 12.1
modern 11.9
restaurant 11.7
suit 11.7
portrait 11.6
lifestyle 11.6
talking 11.4
cheerful 11.4
employee 11.3
education 11.3
communication 10.9
boss 10.5
together 10.5
cornet 10.5
teamwork 10.2
confident 10
interior 9.7
device 9.5
businesspeople 9.5
classroom 9.4
happiness 9.4
wine 9.2
indoor 9.1
holding 9.1
success 8.8
standing 8.7
musician 8.7
love 8.7
hall 8.6
glass 8.6
togetherness 8.5
two 8.5
learning 8.5
presentation 8.4
service 8.3
student 8.3
training 8.3
phone 8.3
singer 8.3
outfit 8.3
grand piano 7.9
speaker 7.7
dining-room attendant 7.7
drinking 7.7
life 7.6
horizontal 7.5
enjoyment 7.5
study 7.5
coffee 7.4
successful 7.3
new 7.3
board 7.2
black 7.2
looking 7.2
home 7.2

Google
created on 2022-02-04

Coat 86
Table 84.4
Suit 77.2
Snapshot 74.3
Event 71.7
Art 70.1
Monochrome 68.9
Monochrome photography 68.4
Vintage clothing 67.7
Team 66
Stock photography 62.7
Room 62.6
Font 62.4
History 61.4
Service 59.8
Visual arts 54.5
Chair 51

Microsoft
created on 2022-02-04

person 96.8
window 94.6
clothing 85.3
text 85.1
man 77.9
concert 74.3
black and white 70.2
posing 52.3

Face analysis

Amazon

Google

AWS Rekognition

Age 38-46
Gender Male, 78.4%
Calm 93.3%
Surprised 5%
Confused 0.5%
Fear 0.4%
Sad 0.3%
Disgusted 0.2%
Happy 0.2%
Angry 0.2%

AWS Rekognition

Age 45-53
Gender Male, 98.8%
Calm 22.3%
Sad 14.8%
Surprised 14.3%
Confused 12.6%
Happy 12.2%
Fear 11.8%
Angry 7.6%
Disgusted 4.4%

AWS Rekognition

Age 16-22
Gender Male, 81.7%
Calm 61.8%
Happy 16.3%
Confused 8.9%
Sad 7.1%
Angry 1.9%
Disgusted 1.5%
Surprised 1.3%
Fear 1.3%

AWS Rekognition

Age 54-64
Gender Male, 100%
Sad 95.4%
Calm 2.9%
Angry 0.5%
Disgusted 0.5%
Confused 0.2%
Happy 0.2%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 45-53
Gender Male, 59.5%
Calm 49.4%
Happy 23.2%
Sad 13.7%
Fear 3.8%
Surprised 3.2%
Angry 2.8%
Disgusted 2.5%
Confused 1.3%

AWS Rekognition

Age 47-53
Gender Male, 100%
Calm 95.6%
Sad 2.4%
Confused 0.7%
Disgusted 0.4%
Angry 0.4%
Happy 0.2%
Surprised 0.1%
Fear 0.1%

AWS Rekognition

Age 13-21
Gender Female, 95.9%
Happy 66.9%
Fear 16%
Calm 10%
Confused 2%
Surprised 1.7%
Disgusted 1.6%
Sad 0.9%
Angry 0.7%

AWS Rekognition

Age 34-42
Gender Male, 94.3%
Sad 57.5%
Calm 34.9%
Confused 5%
Fear 1%
Angry 0.5%
Happy 0.5%
Disgusted 0.3%
Surprised 0.3%

AWS Rekognition

Age 23-31
Gender Male, 74.8%
Calm 88.3%
Sad 7.6%
Fear 1.8%
Happy 1.3%
Confused 0.4%
Disgusted 0.3%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 39-47
Gender Female, 86.5%
Calm 48.5%
Surprised 24.9%
Confused 15.9%
Sad 6.6%
Disgusted 1.4%
Happy 0.9%
Angry 0.9%
Fear 0.7%

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 85.6%
Confused 8.3%
Sad 2.4%
Happy 1.6%
Angry 0.9%
Disgusted 0.4%
Surprised 0.4%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.4%
Suit 81.1%

Captions

Microsoft

a group of people posing for a photo in front of a window 91.4%
a group of people standing in front of a window 91.3%
a group of people standing in front of a window posing for the camera 87.6%

Text analysis

Amazon

4
SAFETY
KODAK