Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4584.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Human 99.2
Person 99.2
Person 99.2
Person 99
Person 98.9
Person 98.5
Person 97.7
Person 97.6
Person 95.7
Person 94.7
Person 94.4
Monitor 89.3
Electronics 89.3
Display 89.3
Screen 89.3
Person 88.8
Person 87.3
Person 85.2
Person 80.7
Person 79.6
Person 76.1
Vehicle 73.4
Transportation 73.4
Person 72.2
Person 72.1
Person 70.4
Person 69.7
Person 68.3
Text 66.3
Person 65.6
Person 65.6
Person 63.8
People 63.2
Military Uniform 55.1
Military 55.1

Imagga
created on 2022-01-08

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

Face analysis

Amazon

Google

AWS Rekognition

Age 26-36
Gender Female, 99.4%
Happy 99.8%
Calm 0.1%
Disgusted 0%
Surprised 0%
Confused 0%
Sad 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 14-22
Gender Male, 88.5%
Calm 71.9%
Disgusted 13.5%
Sad 4.7%
Confused 2.9%
Happy 2.8%
Angry 2.1%
Fear 1.3%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Male, 99.5%
Calm 91.6%
Sad 4.5%
Happy 0.9%
Fear 0.8%
Surprised 0.8%
Confused 0.7%
Angry 0.5%
Disgusted 0.3%

AWS Rekognition

Age 33-41
Gender Male, 84.3%
Calm 99.5%
Sad 0.3%
Surprised 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%
Confused 0%
Fear 0%

AWS Rekognition

Age 18-26
Gender Male, 87.6%
Sad 26.9%
Surprised 25.7%
Fear 25.3%
Calm 13.5%
Disgusted 5%
Angry 2.4%
Happy 0.6%
Confused 0.5%

AWS Rekognition

Age 19-27
Gender Male, 99.1%
Calm 32.4%
Angry 30.7%
Sad 25.7%
Confused 5.1%
Disgusted 2.8%
Fear 1.6%
Surprised 0.9%
Happy 0.8%

AWS Rekognition

Age 6-14
Gender Male, 92.5%
Calm 56.7%
Happy 13.9%
Sad 9%
Fear 7.8%
Angry 4.4%
Disgusted 4.4%
Surprised 1.9%
Confused 1.9%

AWS Rekognition

Age 6-14
Gender Male, 98%
Calm 99.2%
Sad 0.3%
Confused 0.2%
Disgusted 0.1%
Happy 0.1%
Angry 0.1%
Fear 0%
Surprised 0%

AWS Rekognition

Age 22-30
Gender Male, 77.8%
Calm 32.8%
Disgusted 21.4%
Happy 18.7%
Sad 11.8%
Angry 4.6%
Fear 4.5%
Confused 4%
Surprised 2.1%

AWS Rekognition

Age 28-38
Gender Male, 87.1%
Calm 66.9%
Fear 14.5%
Sad 6.8%
Disgusted 4.5%
Happy 4.3%
Angry 1.6%
Confused 0.8%
Surprised 0.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.2%
Monitor 89.3%

Captions

Microsoft

graphical user interface, website 99%

Text analysis

Amazon

5
SUPER
4
6
SUPER XX
XX
9
g

Google

SUPER
X
SUPER X x
x