Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4583.1-3

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4583.1-3

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Interior Design 100
Indoors 100
Human 99.6
Person 99.6
Person 99
Person 99
Person 98.9
Person 98.6
Person 98.5
Person 98.2
Person 97.7
Person 93.6
Monitor 86.9
Electronics 86.9
Display 86.9
Screen 86.9
Person 83.7
Person 81.7
Room 79.9
Person 78
Car 76.5
Transportation 76.5
Vehicle 76.5
Automobile 76.5
Car 68.3
Person 68.3
Person 61.9
Cinema 58.4
Theater 58.4
Advertisement 57.1
Text 56.9
Collage 56.3
Poster 56.3
Person 55.8
Person 44.8

Clarifai
created on 2023-10-25

movie 99.9
negative 99.6
filmstrip 98.8
people 98.7
slide 98
exposed 97.3
art 96.9
screen 96.8
photograph 96.3
cinematography 95.7
video 95.6
analogue 95
collage 93.8
noisy 93.1
analog 90.5
man 90.4
woman 90
video recording 89.7
retro 89.1
street 89

Imagga
created on 2022-01-08

monitor 72
electronic equipment 54.8
television 53.8
equipment 45.9
broadcasting 35.3
telecommunication 27
digital 19.4
technology 18.5
computer 16.9
business 16.4
medium 16
case 15.7
screen 15.6
black 15
modern 13.3
film 12.4
design 12.4
network 12
office 11.9
information 11.5
light 11.4
urban 11.3
car 11.3
connection 11
architecture 10.9
communication 10.9
people 10.6
tech 10.4
glass 10.1
building 10.1
data 10
city 10
hand 9.9
art 9.7
collage 9.6
center 9.6
system 9.5
service 9.2
frame 9.1
telecommunication system 8.8
interior 8.8
window 8.8
man 8.7
movie 8.7
media 8.6
display 8.5
industry 8.5
speed 8.2
transport 8.2
transportation 8.1
object 8.1
3d 7.7
your 7.7
shop 7.7
hardware 7.7
old 7.7
cable 7.6
electronic 7.5
camera 7.4
negative 7.4
entertainment 7.4
street 7.4
global 7.3
vehicle 7.2
server 7.1
travel 7

Google
created on 2022-01-08

Standing 86.4
Television set 84
Font 82.9
Motor vehicle 80.6
Display device 78.3
Electronic device 75.7
Window 71.3
Art 71.1
Monochrome 70.1
Suit 70
Multimedia 69.9
Car 68.9
Room 64.4
Advertising 64.1
Monochrome photography 63.8
Flat panel display 63.5
History 62.2
Luxury vehicle 61.9
Visual arts 58.3
Team 56.9

Microsoft
created on 2022-01-08

screenshot 96.2
text 90.9
billboard 68.4
picture frame 60.9
subway 24.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 0-4
Gender Male, 98.4%
Calm 84.9%
Sad 10.5%
Angry 3.2%
Confused 0.5%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%
Happy 0.1%

AWS Rekognition

Age 10-18
Gender Female, 73%
Calm 89.6%
Angry 4.4%
Sad 3.1%
Confused 1.6%
Disgusted 0.5%
Happy 0.3%
Surprised 0.3%
Fear 0.3%

AWS Rekognition

Age 10-18
Gender Female, 97.8%
Happy 98.9%
Calm 0.5%
Sad 0.2%
Disgusted 0.1%
Surprised 0.1%
Angry 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 6-14
Gender Male, 68.3%
Happy 42.9%
Calm 15.1%
Surprised 11.3%
Angry 9.1%
Fear 8.4%
Sad 5.5%
Disgusted 4.8%
Confused 3%

AWS Rekognition

Age 2-8
Gender Female, 94.8%
Sad 73.8%
Calm 22.1%
Confused 1.8%
Happy 0.5%
Angry 0.5%
Disgusted 0.5%
Fear 0.4%
Surprised 0.4%

AWS Rekognition

Age 41-49
Gender Male, 66.1%
Calm 90.6%
Angry 8.3%
Sad 0.3%
Happy 0.3%
Disgusted 0.2%
Surprised 0.1%
Fear 0.1%
Confused 0.1%

AWS Rekognition

Age 6-14
Gender Female, 99.8%
Sad 60.4%
Calm 34.5%
Confused 3.5%
Angry 0.6%
Disgusted 0.3%
Surprised 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 24-34
Gender Male, 62.9%
Calm 93.5%
Surprised 4.1%
Disgusted 0.6%
Angry 0.6%
Happy 0.5%
Sad 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 20-28
Gender Male, 99.9%
Disgusted 40%
Sad 37.2%
Calm 12.6%
Angry 5.3%
Surprised 2%
Happy 1.5%
Fear 1.1%
Confused 0.3%

AWS Rekognition

Age 25-35
Gender Male, 52%
Happy 47.2%
Calm 36.2%
Confused 5.8%
Sad 5.1%
Disgusted 2.5%
Angry 2.2%
Surprised 0.7%
Fear 0.4%

AWS Rekognition

Age 18-26
Gender Male, 99.8%
Calm 97.5%
Happy 0.6%
Sad 0.5%
Angry 0.4%
Disgusted 0.3%
Surprised 0.3%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 9-17
Gender Female, 99.4%
Calm 91.2%
Angry 5.8%
Sad 1.9%
Happy 0.3%
Surprised 0.3%
Disgusted 0.2%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 10-18
Gender Male, 97.5%
Calm 87.3%
Sad 6.1%
Angry 2.4%
Confused 1.9%
Happy 1.1%
Surprised 0.6%
Disgusted 0.4%
Fear 0.3%

AWS Rekognition

Age 18-26
Gender Male, 74.8%
Calm 99.4%
Happy 0.2%
Sad 0.2%
Disgusted 0.1%
Angry 0.1%
Surprised 0.1%
Fear 0%
Confused 0%

AWS Rekognition

Age 6-16
Gender Female, 61.9%
Calm 97.4%
Sad 0.7%
Confused 0.5%
Happy 0.4%
Surprised 0.4%
Disgusted 0.3%
Angry 0.2%
Fear 0.2%

AWS Rekognition

Age 19-27
Gender Male, 99.6%
Calm 98.7%
Sad 0.6%
Angry 0.2%
Confused 0.2%
Happy 0.1%
Disgusted 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 11-19
Gender Male, 95.7%
Calm 94.4%
Sad 2.2%
Angry 1.6%
Confused 0.5%
Happy 0.5%
Disgusted 0.4%
Fear 0.2%
Surprised 0.2%

AWS Rekognition

Age 18-24
Gender Male, 99.2%
Calm 94%
Happy 2.7%
Sad 1.1%
Angry 0.6%
Disgusted 0.5%
Confused 0.4%
Fear 0.4%
Surprised 0.2%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Feature analysis

Amazon

Person 99.6%
Monitor 86.9%
Car 76.5%

Categories

Imagga

cars vehicles 85.7%
text visuals 6.4%
interior objects 3.3%
streetview architecture 1.4%
food drinks 1.4%

Captions

Microsoft
created on 2022-01-08

graphical user interface, website 99.8%

Text analysis

Amazon

EASTMAN
SUPER
2
E
EASTMAN D
SUPER XX
LASC
D
XX
KORE

Google

EASTMAN 41: SUPER XX
41:
XX
EASTMAN
SUPER