Human Generated Data

Title

Untitled (man at podium draped with American flags)

Date

c. 1940, printed later

People

Artist: Harry Annas, American 1897 - 1980

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.14147

Human Generated Data

Title

Untitled (man at podium draped with American flags)

People

Artist: Harry Annas, American 1897 - 1980

Date

c. 1940, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Interior Design 99.9
Indoors 99.9
Person 98.3
Human 98.3
Person 96.8
Person 96.2
Person 95.2
Crowd 94.3
Person 93.6
Person 93.3
Person 91.3
Person 85.5
Person 85
Person 82.3
Audience 81.7
Person 74.8
Person 72.1
Person 65.3
People 65
Apparel 64.8
Clothing 64.8
Person 61
Person 59.2
Face 56.9
Coat 56.5
Overcoat 56.5

Imagga
created on 2022-01-23

man 29.7
newspaper 25.5
person 23.3
male 22.1
people 21.7
product 19.1
silhouette 18.2
black 17.4
brass 16.7
business 16.4
cornet 15.9
businessman 15.9
wind instrument 15.5
musical instrument 15.4
creation 15.2
men 14.6
adult 14.6
office 12.2
sitting 12
work 11
world 10.8
photographer 10.5
music 9.9
working 9.7
couple 9.6
alone 9.1
sax 9.1
portrait 9.1
building 9
shadow 9
technology 8.9
group 8.9
happy 8.8
women 8.7
light 8.7
meeting 8.5
room 8.4
stringed instrument 8.3
sky 8.3
indoor 8.2
team 8.1
interior 8
device 7.9
love 7.9
modern 7.7
city 7.5
symbol 7.4
professional 7.4
metal 7.2
suit 7.2
night 7.1
architecture 7

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.8
person 92.9
black and white 92
monitor 90.9
clothing 90.6
street 86.7
man 84.9
people 64.1
computer 40.8
display 27.8
picture frame 6.8

Face analysis

Amazon

Google

AWS Rekognition

Age 41-49
Gender Male, 99.4%
Disgusted 86.9%
Angry 7.9%
Happy 1.8%
Confused 1%
Sad 1%
Surprised 0.7%
Fear 0.5%
Calm 0.3%

AWS Rekognition

Age 22-30
Gender Male, 100%
Calm 94.6%
Confused 2.7%
Angry 1.3%
Sad 1.1%
Surprised 0.2%
Disgusted 0.1%
Happy 0%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 99.8%
Calm 95.5%
Sad 2.2%
Confused 1.2%
Angry 0.4%
Surprised 0.2%
Disgusted 0.2%
Fear 0.2%
Happy 0.1%

AWS Rekognition

Age 16-24
Gender Male, 82.1%
Calm 53.3%
Sad 31.6%
Fear 6%
Disgusted 5%
Confused 1.8%
Angry 0.9%
Happy 0.6%
Surprised 0.6%

AWS Rekognition

Age 23-31
Gender Male, 70.1%
Fear 93.5%
Confused 2.4%
Calm 1.4%
Sad 1.4%
Surprised 0.6%
Angry 0.3%
Disgusted 0.2%
Happy 0.1%

AWS Rekognition

Age 29-39
Gender Female, 74.5%
Calm 40.9%
Disgusted 31.8%
Surprised 9.7%
Happy 9.4%
Sad 2.6%
Fear 2.2%
Confused 1.9%
Angry 1.4%

AWS Rekognition

Age 18-26
Gender Female, 78%
Calm 57.5%
Surprised 16.8%
Fear 11.6%
Angry 6.1%
Disgusted 3.7%
Sad 1.6%
Happy 1.4%
Confused 1.3%

AWS Rekognition

Age 1-7
Gender Male, 86.2%
Sad 73.6%
Calm 25%
Confused 0.3%
Disgusted 0.3%
Happy 0.3%
Fear 0.2%
Angry 0.2%
Surprised 0.1%

AWS Rekognition

Age 35-43
Gender Male, 99.9%
Calm 72.5%
Surprised 12.4%
Happy 5.9%
Angry 3.8%
Sad 1.9%
Confused 1.7%
Disgusted 1%
Fear 0.8%

AWS Rekognition

Age 29-39
Gender Male, 97.6%
Calm 73.7%
Sad 14.4%
Angry 3.9%
Disgusted 3.5%
Confused 2.5%
Surprised 0.7%
Fear 0.7%
Happy 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.3%

Captions

Microsoft

a screen shot of a man 86.1%
a man sitting in front of a television screen 48.2%
a man sitting in front of a television 45.4%

Text analysis

Amazon

SAFETY
KODAK SAFETY FILM
FILM
KODAK
D

Google

KODAK SAFETY FILM
KODAK
SAFETY
FILM