Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4586.1-4

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4586.1-4

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.3
Person 98.9
Person 98.8
Person 98.3
Person 97.8
Person 97.6
Person 96.3
Person 95
Person 94.6
Person 93.9
Person 92.6
Funeral 87.2
Transportation 85.5
Automobile 85.5
Car 85.5
Vehicle 85.5
Person 85
Person 84.8
Person 84.6
Person 83.1
Person 83
Person 82.9
Military 81.5
Military Uniform 80.9
Person 74.4
People 73.1
Person 71
Crowd 59.2
Officer 59.1
Monitor 57.7
Screen 57.7
Electronics 57.7
Display 57.7
Wheel 57.1
Machine 57.1
Army 56.2
Armored 56.2
Person 54.7
Person 43.1

Clarifai
created on 2023-10-25

people 99.6
movie 97.7
group 96.3
man 94.1
woman 93
train 90.4
adult 89.1
many 89.1
group together 87.2
transportation system 84.5
railway 84.3
wear 82
vehicle 81.3
military 81.3
war 80.8
leader 80.3
uniform 78.1
soldier 77.9
screen 77.7
street 77.4

Imagga
created on 2022-01-08

television 51.7
barbershop 51.2
shop 51
mercantile establishment 38.3
place of business 25.5
telecommunication system 25.2
case 25.2
people 16.7
business 16.4
black 15.6
broadcasting 14.5
building 13.7
city 13.3
architecture 13.3
man 12.8
establishment 12.7
light 12.7
glass 12.4
urban 12.2
monitor 11.5
interior 11.5
modern 11.2
office 10.6
equipment 10.4
technology 10.4
telecommunication 10.1
silhouette 9.9
window 9.9
transportation 9.9
night 9.8
information 9.7
digital 9.7
counter 9.4
finance 9.3
travel 9.1
transport 9.1
computer 8.8
chair 8.5
place 8.4
display 8.4
back 8.3
indoor 8.2
working 7.9
design 7.9
public 7.8
men 7.7
waiting 7.7
media 7.6
screen 7.5
restaurant 7.2
passenger 7.2
adult 7.1

Google
created on 2022-01-08

Picture frame 93.9
Coat 90.4
Font 83.9
Suit 83.3
Television set 80.2
Rectangle 78.5
Art 77.1
Display device 74.8
White-collar worker 73.4
Event 72.1
Multimedia 71.3
Crowd 64.4
History 63.5
Visual arts 63.3
Room 61.8
Team 59.8
Advertising 58.5
Collection 55.4
Rolling stock 55.2
Public transport 55

Microsoft
created on 2022-01-08

text 99.1
person 91.4
screenshot 89.5
man 87.5
clothing 81.5
billboard 77.6
poster 55.3
picture frame 51.2
kitchen appliance 12.6
subway 12

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 18-26
Gender Male, 100%
Calm 91.4%
Disgusted 4.3%
Confused 2.4%
Sad 0.7%
Angry 0.4%
Surprised 0.4%
Happy 0.2%
Fear 0.2%

AWS Rekognition

Age 38-46
Gender Male, 99.7%
Calm 87.1%
Happy 10.1%
Confused 0.7%
Sad 0.6%
Surprised 0.5%
Disgusted 0.4%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 64.6%
Angry 25.7%
Sad 3.5%
Confused 2.7%
Disgusted 1.3%
Surprised 1%
Fear 0.6%
Happy 0.6%

AWS Rekognition

Age 22-30
Gender Male, 97.9%
Sad 61.9%
Calm 22.3%
Angry 3.7%
Confused 3.3%
Disgusted 3.2%
Happy 2.5%
Surprised 1.8%
Fear 1.5%

AWS Rekognition

Age 13-21
Gender Female, 99.4%
Calm 99.4%
Sad 0.4%
Confused 0.1%
Angry 0%
Disgusted 0%
Surprised 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 20-28
Gender Male, 98.4%
Disgusted 48%
Confused 16.8%
Happy 15%
Angry 13.2%
Surprised 3.5%
Sad 1.6%
Calm 1.3%
Fear 0.6%

AWS Rekognition

Age 50-58
Gender Male, 100%
Calm 91.3%
Disgusted 3.6%
Sad 1.7%
Surprised 1.2%
Angry 1.1%
Confused 0.7%
Happy 0.4%
Fear 0.1%

AWS Rekognition

Age 22-30
Gender Male, 99.2%
Calm 88.3%
Disgusted 3.7%
Sad 2.9%
Happy 1.5%
Surprised 1.3%
Confused 1%
Angry 0.8%
Fear 0.5%

AWS Rekognition

Age 2-8
Gender Male, 99.8%
Calm 42.7%
Angry 41.5%
Sad 5.7%
Fear 2.6%
Happy 2.4%
Disgusted 2.3%
Confused 2%
Surprised 0.8%

AWS Rekognition

Age 21-29
Gender Male, 99.1%
Calm 91.7%
Sad 4.5%
Angry 0.8%
Confused 0.8%
Happy 0.8%
Disgusted 0.6%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 25-35
Gender Male, 95.3%
Calm 92.1%
Sad 1.9%
Surprised 1.5%
Confused 1.5%
Disgusted 1.5%
Angry 0.6%
Fear 0.5%
Happy 0.4%

AWS Rekognition

Age 13-21
Gender Male, 73.8%
Calm 71.2%
Happy 8.7%
Sad 6.6%
Angry 5.1%
Disgusted 4.3%
Surprised 2.4%
Fear 1.2%
Confused 0.6%

AWS Rekognition

Age 23-33
Gender Male, 72.4%
Calm 62.2%
Happy 16.1%
Sad 15.6%
Angry 1.5%
Fear 1.4%
Disgusted 1.3%
Surprised 1%
Confused 1%

AWS Rekognition

Age 13-21
Gender Male, 99.7%
Calm 39.4%
Sad 29.1%
Angry 12.6%
Fear 10.5%
Disgusted 3%
Happy 2.8%
Confused 1.3%
Surprised 1.2%

AWS Rekognition

Age 6-12
Gender Male, 99.9%
Calm 92.4%
Sad 2.7%
Disgusted 1.3%
Fear 0.9%
Angry 0.9%
Surprised 0.6%
Happy 0.6%
Confused 0.5%

AWS Rekognition

Age 16-24
Gender Male, 86.6%
Calm 98.8%
Angry 0.7%
Sad 0.2%
Surprised 0.1%
Happy 0.1%
Confused 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 10-18
Gender Male, 88.5%
Calm 91%
Sad 3.6%
Disgusted 1.6%
Fear 0.9%
Angry 0.8%
Happy 0.8%
Confused 0.8%
Surprised 0.5%

AWS Rekognition

Age 18-24
Gender Male, 99.8%
Calm 81.7%
Angry 11.7%
Sad 4.5%
Surprised 0.7%
Disgusted 0.5%
Confused 0.4%
Happy 0.3%
Fear 0.2%

AWS Rekognition

Age 23-33
Gender Male, 88.5%
Disgusted 64.2%
Sad 12.5%
Happy 5.1%
Fear 4.2%
Confused 4%
Calm 3.9%
Angry 3.4%
Surprised 2.7%

AWS Rekognition

Age 19-27
Gender Male, 91.4%
Calm 71.2%
Sad 18.3%
Fear 6.9%
Angry 1.8%
Disgusted 0.9%
Surprised 0.4%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 16-24
Gender Male, 99.3%
Calm 84.4%
Sad 6.5%
Angry 3.4%
Fear 3.1%
Confused 0.9%
Disgusted 0.6%
Happy 0.6%
Surprised 0.4%

AWS Rekognition

Age 16-24
Gender Male, 91.2%
Calm 67.2%
Angry 8.6%
Confused 7.4%
Sad 7.2%
Disgusted 4.3%
Surprised 2.1%
Happy 1.8%
Fear 1.4%

AWS Rekognition

Age 25-35
Gender Male, 99.8%
Calm 40%
Angry 34%
Disgusted 8.4%
Happy 6%
Confused 4%
Sad 3.4%
Surprised 2.2%
Fear 2%

AWS Rekognition

Age 23-33
Gender Female, 60.6%
Sad 50.2%
Confused 31.3%
Calm 9.3%
Disgusted 3.3%
Happy 1.8%
Surprised 1.4%
Fear 1.4%
Angry 1.3%

AWS Rekognition

Age 4-10
Gender Male, 78.6%
Calm 94.9%
Happy 1.8%
Sad 1.6%
Disgusted 0.5%
Angry 0.4%
Confused 0.3%
Fear 0.3%
Surprised 0.1%

AWS Rekognition

Age 18-24
Gender Male, 84.8%
Calm 83.4%
Happy 4.8%
Sad 3.9%
Angry 3.1%
Fear 1.9%
Surprised 1.2%
Disgusted 1.1%
Confused 0.8%

AWS Rekognition

Age 6-12
Gender Male, 86.3%
Calm 65.2%
Sad 22%
Fear 4.1%
Happy 3.3%
Angry 2.1%
Disgusted 1.5%
Confused 1.1%
Surprised 0.6%

AWS Rekognition

Age 6-14
Gender Female, 87.4%
Calm 48.4%
Happy 43.1%
Angry 3.3%
Surprised 1.5%
Disgusted 1.2%
Sad 1.1%
Confused 0.7%
Fear 0.6%

AWS Rekognition

Age 25-35
Gender Male, 100%
Angry 96.6%
Calm 1.9%
Sad 0.7%
Happy 0.5%
Confused 0.1%
Surprised 0.1%
Fear 0%
Disgusted 0%

AWS Rekognition

Age 4-12
Gender Male, 98.9%
Calm 62.7%
Sad 18.7%
Disgusted 5.6%
Angry 4.8%
Fear 2.5%
Surprised 2.1%
Happy 1.8%
Confused 1.7%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Car 85.5%
Monitor 57.7%
Wheel 57.1%

Captions

Microsoft
created on 2022-01-08

graphical user interface, website 99.7%

Text analysis

Amazon

12
FILM
9
SUPER
10
SUPER XX
XX
FILM SAFETYA
SAFETYA
12 ١٨+
OI
-
THE
- THE
١٨+
CURR

Google

SAFETYA FILM SUPER XX 10
SAFETYA
FILM
SUPER
XX
10