Human Generated Data

Title

Untitled (contact sheet)

Date

20th century

People

Artist: Ben Shahn, American 1898 - 1969

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4583.1-3

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Indoors 100
Interior Design 100
Person 99.6
Human 99.6
Person 99
Person 99
Person 98.9
Person 98.6
Person 98.5
Person 98.2
Person 97.7
Person 93.6
Monitor 86.9
Electronics 86.9
Display 86.9
Screen 86.9
Person 83.7
Person 81.7
Room 79.9
Person 78
Vehicle 76.5
Automobile 76.5
Transportation 76.5
Car 76.5
Car 68.3
Person 68.3
Person 61.9
Theater 58.4
Cinema 58.4
Advertisement 57.1
Text 56.9
Collage 56.3
Poster 56.3
Person 55.8
Person 44.8

Imagga
created on 2022-01-08

monitor 72
electronic equipment 54.8
television 53.8
equipment 45.9
broadcasting 35.3
telecommunication 27
digital 19.4
technology 18.5
computer 16.9
business 16.4
medium 16
case 15.7
screen 15.6
black 15
modern 13.3
film 12.4
design 12.4
network 12
office 11.9
information 11.5
light 11.4
urban 11.3
car 11.3
connection 11
architecture 10.9
communication 10.9
people 10.6
tech 10.4
glass 10.1
building 10.1
data 10
city 10
hand 9.9
art 9.7
collage 9.6
center 9.6
system 9.5
service 9.2
frame 9.1
telecommunication system 8.8
interior 8.8
window 8.8
man 8.7
movie 8.7
media 8.6
display 8.5
industry 8.5
speed 8.2
transport 8.2
transportation 8.1
object 8.1
3d 7.7
your 7.7
shop 7.7
hardware 7.7
old 7.7
cable 7.6
electronic 7.5
camera 7.4
negative 7.4
entertainment 7.4
street 7.4
global 7.3
vehicle 7.2
server 7.1
travel 7

Google
created on 2022-01-08

Microsoft
created on 2022-01-08

screenshot 96.2
text 90.9
billboard 68.4
picture frame 60.9
subway 24.6

Face analysis

Amazon

Google

AWS Rekognition

Age 0-4
Gender Male, 98.4%
Calm 84.9%
Sad 10.5%
Angry 3.2%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Female, 73%
Calm 89.6%
Angry 4.4%
Sad 3.1%
Confused 1.6%
Disgusted 0.5%
Happy 0.3%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 10-18
Gender Female, 97.8%
Happy 98.9%
Calm 0.5%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 68.3%
Happy 42.9%
Calm 15.1%
Surprised 11.3%
Angry 9.1%
Fear 8.4%
Sad 5.5%
Disgusted 4.8%
Confused 3%

AWS Rekognition

Age 2-8
Gender Female, 94.8%
Sad 73.8%
Calm 22.1%
Confused 1.8%
Happy 0.5%
Angry 0.5%
Disgusted 0.5%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 41-49
Gender Male, 66.1%
Calm 90.6%
Angry 8.3%
Sad 0.3%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.8%
Sad 60.4%
Calm 34.5%
Confused 3.5%
Angry 0.6%
Disgusted 0.3%
Surprised 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Male, 62.9%
Calm 93.5%
Surprised 4.1%
Disgusted 0.6%
Angry 0.6%
Happy 0.5%
Sad 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Disgusted 40%
Sad 37.2%
Calm 12.6%
Angry 5.3%
Surprised 2%
Happy 1.5%
Fear 1.1%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Male, 52%
Happy 47.2%
Calm 36.2%
Confused 5.8%
Sad 5.1%
Disgusted 2.5%
Angry 2.2%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.8%
Calm 97.5%
Happy 0.6%
Sad 0.5%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 9-17
Gender Female, 99.4%
Calm 91.2%
Angry 5.8%
Sad 1.9%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 10-18
Gender Male, 97.5%
Calm 87.3%
Sad 6.1%
Angry 2.4%
Confused 1.9%
Happy 1.1%
Surprised 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Male, 74.8%
Calm 99.4%
Happy 0.2%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 6-16
Gender Female, 61.9%
Calm 97.4%
Sad 0.7%
Confused 0.5%
Happy 0.4%
Surprised 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 98.7%
Sad 0.6%
Angry 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 11-19
Gender Male, 95.7%
Calm 94.4%
Sad 2.2%
Angry 1.6%
Confused 0.5%
Happy 0.5%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.2%
Calm 94%
Happy 2.7%
Sad 1.1%
Angry 0.6%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Monitor 86.9%
Car 76.5%

Captions

Microsoft

graphical user interface, website 99.8%

Text analysis

Amazon

EASTMAN
SUPER
2
E
EASTMAN D
SUPER XX
LASC
D
XX
KORE

Google

SUPER
EASTMAN 41: SUPER XX
41:
XX
EASTMAN