Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4612

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4612

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 97
Human 97
Person 91.9
Person 89.4
Interior Design 85.3
Indoors 85.3
Person 83.1
Person 78.6
Monitor 78
Display 78
Electronics 78
Screen 78
Person 68
Head 59.7

Clarifai
created on 2023-10-25

movie 96.6
negative 94.7
people 94.4
art 94.2
screen 93.7
slide 93.3
filmstrip 91.1
picture frame 90.7
no person 89.6
retro 89.6
analogue 89.5
vintage 88.2
old 87.9
technology 86.7
display 83.2
rust 82.6
margin 82.3
industry 81.4
dirty 81.2
desktop 80.9

Imagga
created on 2022-01-08

equipment 90.1
electronic equipment 71.9
sequencer 45.6
apparatus 37.3
amplifier 35.9
technology 25.9
monitor 21.6
equalizer 21.6
digital 20.2
computer 19.3
mixer 18.4
sound 15
close 14.8
black 14.4
business 14
music 13.5
audio 13.4
media 13.3
button 13.2
electronic 13
network 13
system 12.4
modern 11.9
connection 11.9
communication 11.7
screen 11.5
electronics 11.4
data 10.9
closeup 10.8
design 10.7
information 10.6
electrical 10.5
object 10.2
display 10.2
entertainment 10.1
speed 10.1
loudspeaker 10
film 10
retro 9.8
panel 9.6
space 9.3
television 9.3
power 9.2
vintage 9.1
receiver 9.1
old 9
stereo 8.9
record 8.7
video 8.7
finance 8.4
electric 8.4
global 8.2
switch 7.8
device 7.8
3d 7.7
radio receiver 7.7
money 7.6
web 7.6
hand 7.6
tech 7.6
electricity 7.5
radio 7.4
template 7.3
room 7.3
art 7.1
science 7.1
silver 7.1

Google
created on 2022-01-08

Font 83.1
Rectangle 79.1
Audio equipment 78.3
Technology 75.8
Display device 74.1
Electronic device 74.1
Multimedia 66.1
Event 65.2
Monochrome 63.5
Symmetry 62.2
Room 62.1
Monochrome photography 61
Art 59.8
Television set 57.9
Eyelash 56.4
Negative 55.7
Metal 53.7

Microsoft
created on 2022-01-08

text 99.2
screenshot 97.2
old 57.4
electronics 53.1

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-3
Gender Female, 99.4%
Fear 35.6%
Surprised 31.1%
Angry 11.6%
Calm 10.7%
Disgusted 3.8%
Happy 2.9%
Sad 2.9%
Confused 1.3%

AWS Rekognition

Age 0-6
Gender Male, 79.2%
Calm 74.2%
Happy 20.1%
Surprised 1.3%
Sad 1.2%
Disgusted 1%
Angry 0.9%
Fear 0.7%
Confused 0.5%

AWS Rekognition

Age 0-4
Gender Female, 50.6%
Happy 72.7%
Surprised 16.1%
Fear 4.1%
Sad 3.5%
Calm 1.7%
Confused 0.7%
Angry 0.6%
Disgusted 0.6%

AWS Rekognition

Age 0-3
Gender Female, 53.2%
Surprised 50.7%
Fear 46.1%
Disgusted 0.9%
Confused 0.9%
Calm 0.5%
Sad 0.4%
Angry 0.3%
Happy 0.3%

AWS Rekognition

Age 0-3
Gender Female, 96.1%
Fear 92.2%
Calm 4.9%
Surprised 0.8%
Happy 0.8%
Sad 0.5%
Confused 0.4%
Disgusted 0.2%
Angry 0.2%

AWS Rekognition

Age 1-7
Gender Female, 90.5%
Sad 66.6%
Calm 12.6%
Angry 9%
Surprised 5.9%
Happy 2.4%
Disgusted 1.8%
Fear 1.4%
Confused 0.3%

AWS Rekognition

Age 0-4
Gender Female, 98.4%
Calm 49.4%
Happy 43.6%
Surprised 2.4%
Fear 1.4%
Angry 1.1%
Sad 1%
Disgusted 0.8%
Confused 0.3%

AWS Rekognition

Age 43-51
Gender Male, 90.1%
Calm 99.1%
Happy 0.4%
Sad 0.2%
Confused 0.1%
Angry 0.1%
Disgusted 0.1%
Surprised 0%
Fear 0%

AWS Rekognition

Age 0-3
Gender Female, 99.2%
Calm 92.8%
Surprised 3.8%
Happy 1.1%
Sad 0.9%
Disgusted 0.5%
Angry 0.5%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 2-10
Gender Female, 98.1%
Calm 91.5%
Sad 3.4%
Disgusted 1.4%
Happy 1%
Angry 0.8%
Surprised 0.7%
Fear 0.7%
Confused 0.4%

AWS Rekognition

Age 0-3
Gender Female, 100%
Calm 90%
Surprised 6%
Disgusted 1.1%
Happy 0.8%
Sad 0.7%
Angry 0.6%
Fear 0.4%
Confused 0.3%

AWS Rekognition

Age 10-18
Gender Female, 100%
Fear 44%
Calm 18.5%
Surprised 14%
Happy 12.3%
Disgusted 5.2%
Confused 2.2%
Angry 2.2%
Sad 1.6%

AWS Rekognition

Age 4-10
Gender Female, 100%
Fear 99.5%
Surprised 0.1%
Disgusted 0.1%
Sad 0.1%
Confused 0.1%
Calm 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 6-14
Gender Female, 100%
Fear 90.1%
Sad 3.8%
Happy 2.1%
Confused 1.2%
Surprised 1%
Calm 0.9%
Disgusted 0.5%
Angry 0.3%

AWS Rekognition

Age 2-10
Gender Female, 100%
Happy 43.2%
Sad 18.6%
Surprised 9.1%
Calm 7.9%
Fear 7.2%
Disgusted 6%
Angry 5.9%
Confused 2.1%

AWS Rekognition

Age 6-12
Gender Female, 99.5%
Surprised 99.7%
Fear 0.2%
Calm 0.1%
Angry 0%
Sad 0%
Confused 0%
Disgusted 0%
Happy 0%

AWS Rekognition

Age 4-12
Gender Female, 98%
Surprised 71.1%
Calm 16.9%
Fear 5.9%
Happy 1.6%
Disgusted 1.4%
Angry 1.3%
Confused 1%
Sad 0.8%

AWS Rekognition

Age 0-4
Gender Male, 96.3%
Surprised 39.1%
Calm 20.8%
Fear 15.9%
Happy 8.2%
Confused 7.1%
Sad 6.8%
Disgusted 1.1%
Angry 1%

AWS Rekognition

Age 0-4
Gender Female, 100%
Fear 85.8%
Surprised 11.5%
Happy 1.2%
Sad 0.5%
Angry 0.3%
Calm 0.3%
Disgusted 0.2%
Confused 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97%
Monitor 78%

Categories

Imagga

text visuals 58.4%
interior objects 32.3%
food drinks 3.1%
paintings art 2.1%
events parties 1.4%
cars vehicles 1.3%

Captions

Microsoft
created on 2022-01-08

an old photo of a person 41.2%

Text analysis

Amazon

20
SUPER
SUPER XX
XX

Google

20 SUPER XX 20
20
SUPER
XX