Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4628.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4628.1-2

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.5
Human 99.5
Person 99.4
Person 99.3
Person 99.2
Person 98.7
Person 98.6
Person 98.1
Person 97.2
Person 94.1
Person 91.6
Person 89.9
Person 86.9
Person 85.3
Clothing 84.3
Apparel 84.3
Interior Design 82.6
Indoors 82.6
Person 81.8
Person 76.7
Helmet 69.5
People 69.3
Screen 65
Electronics 65
Person 62.7
Display 62.2
Person 61.3
Coat 59.8
Monitor 57.4
Overcoat 56.3
Person 52.3
Person 49.7

Clarifai
created on 2023-10-25

people 99.3
movie 98.7
negative 97.5
group 94.7
woman 93.2
adult 92.3
art 91.9
man 91.5
street 91.3
filmstrip 90
screen 89.3
wear 89.1
collage 87.1
two 85.1
room 83.1
photograph 82.6
window 81.7
war 81.3
group together 81.2
portrait 81.1

Imagga
created on 2022-01-08

television 56.1
negative 40.4
film 38.7
monitor 38.4
broadcasting 38.2
electronic equipment 29.7
telecommunication 28.7
equipment 26
architecture 23.4
photographic paper 21.7
medium 18.5
building 17.1
city 15
photographic equipment 14.5
travel 12.7
art 12.4
urban 12.2
business 12.1
culture 12
night 11.5
old 11.1
landmark 10.8
screen 10.5
case 10.4
historic 10.1
strip 9.7
destination 9.3
water 9.3
web site 9.1
sky 8.9
digital 8.9
structure 8.8
symbol 8.7
palace 8.7
black 8.4
house 8.3
vintage 8.3
retro 8.2
history 8
light 8
design 7.9
billboard 7.9
sea 7.8
movie 7.7
collage 7.7
construction 7.7
sculpture 7.6
statue 7.6
buildings 7.6
famous 7.4
tourism 7.4
man 7.4
telecommunication system 7.4
computer 7.2
tower 7.2

Google
created on 2022-01-08

Font 80.7
Display device 76.8
Crowd 76
Electronic device 75.5
Art 75.4
Monochrome 72.2
Monochrome photography 69.9
Event 67.8
Room 67.1
History 66.7
Rectangle 63.9
Advertising 63.6
Multimedia 61.9
Stock photography 61.7
Negative 60.7
Suit 60.1
Visual arts 59.6
Team 58.8
Crew 53.4

Microsoft
created on 2022-01-08

text 98.6
wall 95.1
indoor 93.1
screenshot 89.8
picture frame 73.3

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 45-53
Gender Male, 91.2%
Calm 98.6%
Confused 0.6%
Sad 0.2%
Surprised 0.2%
Happy 0.1%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 51-59
Gender Male, 99.2%
Calm 96.8%
Confused 1.4%
Surprised 0.7%
Happy 0.6%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%

AWS Rekognition

Age 37-45
Gender Male, 99.9%
Happy 99.6%
Calm 0.3%
Sad 0%
Surprised 0%
Confused 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 70-80
Gender Male, 87.4%
Calm 98.3%
Sad 0.5%
Confused 0.5%
Happy 0.4%
Surprised 0.1%
Fear 0.1%
Disgusted 0.1%
Angry 0%

AWS Rekognition

Age 6-16
Gender Female, 100%
Happy 99.5%
Calm 0.2%
Sad 0.1%
Fear 0.1%
Confused 0%
Angry 0%
Surprised 0%
Disgusted 0%

AWS Rekognition

Age 28-38
Gender Female, 100%
Happy 96.2%
Fear 1.7%
Calm 1.1%
Surprised 0.3%
Confused 0.2%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%

AWS Rekognition

Age 53-61
Gender Female, 95.3%
Calm 48.1%
Sad 45.6%
Surprised 2.2%
Angry 1%
Confused 0.9%
Fear 0.8%
Happy 0.7%
Disgusted 0.6%

AWS Rekognition

Age 30-40
Gender Female, 83.5%
Calm 77.4%
Confused 6.7%
Sad 4.5%
Happy 4%
Surprised 2.6%
Angry 2.3%
Fear 1.5%
Disgusted 1%

AWS Rekognition

Age 30-40
Gender Female, 75.5%
Calm 77.5%
Sad 17.2%
Happy 3.8%
Fear 0.6%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%
Surprised 0.2%

AWS Rekognition

Age 22-30
Gender Female, 62.3%
Happy 91.3%
Calm 5.4%
Angry 1.5%
Sad 0.7%
Disgusted 0.4%
Surprised 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 23-33
Gender Male, 99.8%
Calm 42.1%
Happy 23.6%
Sad 14.9%
Disgusted 10.4%
Angry 3.7%
Fear 2.6%
Confused 1.7%
Surprised 1.1%

AWS Rekognition

Age 31-41
Gender Male, 99.7%
Sad 31.9%
Calm 30.2%
Angry 14.2%
Surprised 11.8%
Happy 5%
Fear 2.8%
Confused 2.4%
Disgusted 1.7%

AWS Rekognition

Age 28-38
Gender Male, 99.8%
Calm 98%
Sad 1.5%
Angry 0.3%
Happy 0.1%
Confused 0.1%
Disgusted 0%
Surprised 0%
Fear 0%

AWS Rekognition

Age 14-22
Gender Male, 99.4%
Happy 52%
Calm 18.4%
Angry 10.6%
Sad 7.4%
Surprised 4.1%
Fear 3.8%
Disgusted 2.3%
Confused 1.4%

AWS Rekognition

Age 7-17
Gender Male, 82.9%
Angry 36.2%
Sad 31%
Fear 10.4%
Calm 8.3%
Happy 8%
Disgusted 3.8%
Confused 1.2%
Surprised 1.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Helmet 69.5%
Monitor 57.4%

Categories

Imagga

cars vehicles 99%

Text analysis

Amazon

SUPER
24
25
SUPER XX
XX

Google

SUPER
25
25 24 SUPER Xx 25 24
24
Xx