Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4627.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.6
Person 99.3
Person 99.2
Person 98.8
Person 98.7
Person 98.2
Person 98
Person 97.5
Person 97.5
Person 95.9
Person 92.1
Person 89.9
Person 85
Vehicle 71.1
Transportation 71.1
Screen 63.6
Electronics 63.6
Overcoat 61.5
Clothing 61.5
Coat 61.5
Apparel 61.5
Train 59.3
Monitor 59.2
Display 59.2
Suit 58.8

Imagga
created on 2022-01-08

equipment 100
sequencer 100
apparatus 99.9
electronic equipment 33.7
technology 21.5
equalizer 19.9
computer 16
digital 15.4
data 14.6
business 14.6
mixer 13.6
old 13.2
retro 13.1
close 12.5
network 12
industry 11.9
design 11.8
vintage 11.6
collage 11.6
hand 11.4
grunge 11.1
synthesizer 11
finance 11
information 10.6
system 10.5
film 10.4
connection 10
texture 9.7
your 9.7
dollar 9.3
board 9.3
communication 9.2
frame 9.1
city 9.1
global 9.1
art 9.1
dirty 9
black 9
electronic instrument 8.9
screen 8.8
closeup 8.8
text 8.7
hardware 8.6
cable 8.6
control 8.6
tech 8.5
street 8.3
speed 8.2
pattern 8.2
border 8.1
road 8.1
bank 8.1
object 8.1
monitor 8
paper 7.8
money 7.7
electronics 7.6
horizontal 7.5
sign 7.5
entertainment 7.4
graphic 7.3
room 7.3
science 7.1
server 7.1
modern 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 89.9%
Confused 3%
Angry 2.2%
Surprised 2%
Sad 1.4%
Disgusted 0.7%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 76.1%
Sad 13.1%
Surprised 3.6%
Angry 2.7%
Confused 1.6%
Fear 1.1%
Happy 1%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Male, 64.7%
Calm 99.1%
Sad 0.6%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 84.8%
Calm 86.7%
Sad 4.4%
Confused 3.9%
Surprised 1.7%
Angry 1.4%
Happy 0.7%
Fear 0.6%
Disgusted 0.6%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 97.8%
Sad 1.6%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 93.6%
Angry 2.9%
Calm 1.1%
Fear 0.7%
Confused 0.6%
Disgusted 0.5%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.6%
Calm 59.9%
Confused 28.4%
Surprised 3.3%
Sad 3.1%
Disgusted 2.1%
Happy 1.4%
Angry 1.1%
Fear 0.7%

AWS Rekognition

Age 37-45
Gender Male, 56.8%
Happy 96%
Surprised 1%
Calm 0.9%
Angry 0.8%
Sad 0.7%
Disgusted 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 16-24
Gender Female, 94.9%
Sad 87%
Calm 4.9%
Confused 4.1%
Fear 2.3%
Angry 0.7%
Surprised 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Calm 89.3%
Sad 4%
Angry 3%
Surprised 1.4%
Confused 0.8%
Happy 0.7%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 28-38
Gender Male, 94%
Calm 86.2%
Happy 8.6%
Sad 3.5%
Disgusted 0.5%
Confused 0.3%
Surprised 0.3%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 89.9%
Calm 57.3%
Happy 19.1%
Sad 11.8%
Angry 5.4%
Confused 2.9%
Disgusted 1.6%
Surprised 1.5%
Fear 0.5%

AWS Rekognition

Age 1-7
Gender Female, 91.1%
Calm 58.4%
Fear 20%
Surprised 5.5%
Confused 3.7%
Sad 3.5%
Happy 3.4%
Disgusted 3%
Angry 2.6%

AWS Rekognition

Age 29-39
Gender Male, 79%
Disgusted 78.4%
Fear 8.3%
Sad 5.5%
Calm 3.7%
Happy 1.5%
Angry 1.2%
Confused 1%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Male, 98.5%
Calm 73%
Sad 12.9%
Angry 5.1%
Happy 3.7%
Fear 1.8%
Surprised 1.5%
Disgusted 1.1%
Confused 0.9%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 63.1%
Happy 32.2%
Surprised 1.2%
Disgusted 1.1%
Angry 1%
Sad 0.7%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 18-26
Gender Male, 79.1%
Calm 40.3%
Sad 37.8%
Angry 8.3%
Happy 4.1%
Confused 3.9%
Surprised 2.5%
Disgusted 2.2%
Fear 0.8%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

graphical user interface 74.5%

Text analysis

Amazon

23
22
L
MARE CHIARO
MARE CHIARO 178
TAVERNAMESTAURANT
178
OF

Google

23 22 AHE CHI 178 TAVERNARESTAURANT 23 22
23
22
CHI
178
AHE
TAVERNARESTAURANT