Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4621

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4621

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.3
Human 99.3
Person 99
Person 98.9
Person 98.6
Person 96.7
Tie 95.2
Accessories 95.2
Accessory 95.2
Person 85.7
Person 85
Person 81.8
Person 81
Screen 77.9
Electronics 77.9
Display 71.1
People 67.2
Outdoors 67
Water 65.5
Person 65.1
Person 60.9
Monitor 58.6
Furniture 55.6

Clarifai
created on 2023-10-25

movie 99.8
negative 99.7
collage 99.5
people 99.3
filmstrip 99.1
slide 98.7
noisy 98.7
photograph 98.3
exposed 95.7
art 95.5
cinematography 95.3
screen 94.5
moment 93.4
woman 92.9
cinematic 92.3
group 91.7
analogue 90.8
portrait 90.7
window 90.6
locomotive 90.5

Imagga
created on 2022-01-08

case 47.5
shop 28.2
barbershop 28.2
television 23.6
building 21.9
architecture 21.1
old 19.5
mercantile establishment 19.4
broadcasting 16.7
business 16.4
black 15
urban 14.8
equipment 14.2
city 14.1
film 14
art 13.7
retro 13.1
place of business 12.9
house 12.5
vintage 12.4
design 12.4
telecommunication 11.7
glass 11.7
window 11.4
light 11.4
monitor 11.2
negative 11
dirty 10.8
grunge 10.2
office 9.7
computer 9.7
structure 9.6
electronic equipment 9.1
sign 9
technology 8.9
text 8.7
texture 8.3
frame 8.3
exterior 8.3
digital 8.1
symbol 8.1
detail 8
people 7.8
medium 7.8
movie 7.7
pattern 7.5
paint 7.2
home 7.2
interior 7.1
paper 7.1
travel 7
screen 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

text 96.4
screenshot 84.4
picture frame 78.6
person 75.4
clothing 64.1
man 51

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Calm 81.9%
Angry 5%
Confused 4.8%
Sad 4.4%
Fear 1.9%
Surprised 0.9%
Disgusted 0.5%
Happy 0.5%

AWS Rekognition

Age 45-53
Gender Male, 93.5%
Calm 41.1%
Happy 33.9%
Sad 18.9%
Angry 2.1%
Fear 1.3%
Disgusted 1.1%
Confused 1%
Surprised 0.7%

AWS Rekognition

Age 48-54
Gender Female, 100%
Sad 65.4%
Calm 19.5%
Confused 5.1%
Surprised 2.6%
Angry 2.4%
Disgusted 2.4%
Fear 1.6%
Happy 0.9%

AWS Rekognition

Age 23-33
Gender Male, 99.9%
Calm 75.8%
Sad 21%
Confused 1.9%
Angry 0.3%
Fear 0.3%
Happy 0.2%
Surprised 0.2%
Disgusted 0.2%

AWS Rekognition

Age 27-37
Gender Male, 99.3%
Sad 69.1%
Calm 16.8%
Happy 3.9%
Surprised 3.6%
Angry 2.2%
Disgusted 2%
Confused 1.6%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 99.9%
Calm 93.3%
Confused 3.9%
Sad 1.3%
Fear 0.6%
Surprised 0.2%
Angry 0.2%
Happy 0.2%
Disgusted 0.2%

AWS Rekognition

Age 23-33
Gender Male, 97.6%
Calm 65.1%
Sad 22.8%
Fear 4.9%
Happy 2.5%
Angry 1.6%
Disgusted 1.2%
Surprised 1.1%
Confused 0.8%

AWS Rekognition

Age 58-66
Gender Male, 97.8%
Calm 72.9%
Sad 11.7%
Confused 8.5%
Angry 4%
Disgusted 1.1%
Surprised 1%
Fear 0.4%
Happy 0.3%

AWS Rekognition

Age 2-8
Gender Male, 97.1%
Calm 81.7%
Sad 14.5%
Confused 1.6%
Angry 1.2%
Happy 0.4%
Disgusted 0.3%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 18-26
Gender Female, 93.8%
Sad 78.6%
Confused 5%
Calm 4.8%
Angry 4.1%
Happy 3.6%
Fear 2.4%
Disgusted 1%
Surprised 0.6%

AWS Rekognition

Age 35-43
Gender Male, 99.1%
Calm 70.4%
Sad 10%
Confused 6.6%
Happy 5.7%
Fear 3.8%
Disgusted 1.5%
Surprised 1.3%
Angry 0.8%

AWS Rekognition

Age 18-24
Gender Female, 51.1%
Calm 46.7%
Sad 36.2%
Angry 6.9%
Fear 3.5%
Disgusted 2%
Surprised 1.7%
Confused 1.5%
Happy 1.5%

AWS Rekognition

Age 18-24
Gender Male, 87.6%
Calm 66%
Confused 15.5%
Happy 11.1%
Surprised 3.9%
Disgusted 1.6%
Sad 0.8%
Angry 0.6%
Fear 0.4%

AWS Rekognition

Age 16-24
Gender Male, 99.1%
Calm 76.1%
Sad 11.6%
Happy 5.8%
Angry 2.3%
Confused 2%
Disgusted 1.4%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 33-41
Gender Female, 63.6%
Calm 87.2%
Happy 11.1%
Surprised 0.8%
Sad 0.4%
Confused 0.2%
Angry 0.1%
Disgusted 0.1%
Fear 0.1%

Microsoft Cognitive Services

Age 69
Gender Male

Microsoft Cognitive Services

Age 54
Gender Male

Microsoft Cognitive Services

Age 36
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 95.2%
Monitor 58.6%

Captions

Microsoft
created on 2022-01-08

graphical user interface 54.1%

Text analysis

Amazon

12
PAIRON
Sur PAIRON
Sur

Google

12 12
12