Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4627.1-2

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4627.1-2

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.7
Human 99.7
Person 99.6
Person 99.3
Person 99.2
Person 98.8
Person 98.7
Person 98.2
Person 98
Person 97.5
Person 97.5
Person 95.9
Person 92.1
Person 89.9
Person 85
Vehicle 71.1
Transportation 71.1
Screen 63.6
Electronics 63.6
Overcoat 61.5
Clothing 61.5
Apparel 61.5
Coat 61.5
Train 59.3
Monitor 59.2
Display 59.2
Suit 58.8

Clarifai
created on 2023-10-25

movie 99.1
people 99.1
negative 96.8
art 95.7
man 94.6
screen 93.4
slide 93.3
group 92.3
filmstrip 91.6
woman 91.1
adult 90.3
window 89.3
wear 87.4
illustration 86.6
one 85.9
two 85.1
retro 84.5
old 83.6
room 81.8
painting 81.8

Imagga
created on 2022-01-08

equipment 100
sequencer 100
apparatus 99.9
electronic equipment 33.7
technology 21.5
equalizer 19.9
computer 16
digital 15.4
data 14.6
business 14.6
mixer 13.6
old 13.2
retro 13.1
close 12.5
network 12
industry 11.9
design 11.8
vintage 11.6
collage 11.6
hand 11.4
grunge 11.1
synthesizer 11
finance 11
information 10.6
system 10.5
film 10.4
connection 10
texture 9.7
your 9.7
dollar 9.3
board 9.3
communication 9.2
frame 9.1
city 9.1
global 9.1
art 9.1
dirty 9
black 9
electronic instrument 8.9
screen 8.8
closeup 8.8
text 8.7
hardware 8.6
cable 8.6
control 8.6
tech 8.5
street 8.3
speed 8.2
pattern 8.2
border 8.1
road 8.1
bank 8.1
object 8.1
monitor 8
paper 7.8
money 7.7
electronics 7.6
horizontal 7.5
sign 7.5
entertainment 7.4
graphic 7.3
room 7.3
science 7.1
server 7.1
modern 7

Google
created on 2022-01-08

Rectangle 88.3
Font 83.9
Art 79.9
Building 77.4
Television set 77.1
Display device 74.5
Technology 73.6
Electronic device 73.3
Multimedia 72.1
Event 72.1
Flat panel display 70.3
Suit 69
Facade 68.3
Visual arts 67.3
Monochrome 67
Advertising 65.2
Signage 63
Room 60.5
Projection screen 59.8
Monochrome photography 59.8

Microsoft
created on 2022-01-08

screenshot 95.4
text 90.1
vending machine 12.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 49-57
Gender Male, 99.8%
Calm 89.9%
Confused 3%
Angry 2.2%
Surprised 2%
Sad 1.4%
Disgusted 0.7%
Fear 0.4%
Happy 0.4%

AWS Rekognition

Age 18-24
Gender Male, 100%
Calm 76.1%
Sad 13.1%
Surprised 3.6%
Angry 2.7%
Confused 1.6%
Fear 1.1%
Happy 1%
Disgusted 0.8%

AWS Rekognition

Age 16-22
Gender Male, 64.7%
Calm 99.1%
Sad 0.6%
Surprised 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 22-30
Gender Male, 84.8%
Calm 86.7%
Sad 4.4%
Confused 3.9%
Surprised 1.7%
Angry 1.4%
Happy 0.7%
Fear 0.6%
Disgusted 0.6%

AWS Rekognition

Age 48-56
Gender Male, 100%
Calm 97.8%
Sad 1.6%
Angry 0.2%
Confused 0.2%
Surprised 0.1%
Disgusted 0%
Happy 0%
Fear 0%

AWS Rekognition

Age 45-51
Gender Male, 99.9%
Sad 93.6%
Angry 2.9%
Calm 1.1%
Fear 0.7%
Confused 0.6%
Disgusted 0.5%
Surprised 0.4%
Happy 0.2%

AWS Rekognition

Age 21-29
Gender Male, 99.6%
Calm 59.9%
Confused 28.4%
Surprised 3.3%
Sad 3.1%
Disgusted 2.1%
Happy 1.4%
Angry 1.1%
Fear 0.7%

AWS Rekognition

Age 37-45
Gender Male, 56.8%
Happy 96%
Surprised 1%
Calm 0.9%
Angry 0.8%
Sad 0.7%
Disgusted 0.3%
Fear 0.2%
Confused 0.1%

AWS Rekognition

Age 16-24
Gender Female, 94.9%
Sad 87%
Calm 4.9%
Confused 4.1%
Fear 2.3%
Angry 0.7%
Surprised 0.4%
Disgusted 0.3%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.4%
Calm 89.3%
Sad 4%
Angry 3%
Surprised 1.4%
Confused 0.8%
Happy 0.7%
Fear 0.4%
Disgusted 0.3%

AWS Rekognition

Age 28-38
Gender Male, 94%
Calm 86.2%
Happy 8.6%
Sad 3.5%
Disgusted 0.5%
Confused 0.3%
Surprised 0.3%
Angry 0.3%
Fear 0.3%

AWS Rekognition

Age 28-38
Gender Male, 89.9%
Calm 57.3%
Happy 19.1%
Sad 11.8%
Angry 5.4%
Confused 2.9%
Disgusted 1.6%
Surprised 1.5%
Fear 0.5%

AWS Rekognition

Age 1-7
Gender Female, 91.1%
Calm 58.4%
Fear 20%
Surprised 5.5%
Confused 3.7%
Sad 3.5%
Happy 3.4%
Disgusted 3%
Angry 2.6%

AWS Rekognition

Age 29-39
Gender Male, 79%
Disgusted 78.4%
Fear 8.3%
Sad 5.5%
Calm 3.7%
Happy 1.5%
Angry 1.2%
Confused 1%
Surprised 0.6%

AWS Rekognition

Age 23-33
Gender Male, 98.5%
Calm 73%
Sad 12.9%
Angry 5.1%
Happy 3.7%
Fear 1.8%
Surprised 1.5%
Disgusted 1.1%
Confused 0.9%

AWS Rekognition

Age 36-44
Gender Male, 99.9%
Calm 63.1%
Happy 32.2%
Surprised 1.2%
Disgusted 1.1%
Angry 1%
Sad 0.7%
Confused 0.4%
Fear 0.2%

AWS Rekognition

Age 18-26
Gender Male, 79.1%
Calm 40.3%
Sad 37.8%
Angry 8.3%
Happy 4.1%
Confused 3.9%
Surprised 2.5%
Disgusted 2.2%
Fear 0.8%

Microsoft Cognitive Services

Age 47
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft
created on 2022-01-08

graphical user interface 74.5%

Text analysis

Amazon

23
22
L
MARE CHIARO
MARE CHIARO 178
TAVERNAMESTAURANT
178
OF

Google

23 22 AHE CHI 178 TAVERNARESTAURANT 23 22
23
22
AHE
CHI
178
TAVERNARESTAURANT