Human Generated Data

Title

Untitled (contact sheet)
Date

20th century
People

Artist: Ben Shahn, American 1898 - 1969
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4576

Human Generated Data

Title

Untitled (contact sheet)

People

Artist: Ben Shahn, American 1898 - 1969

Date

20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Gift of Bernarda Bryson Shahn, P1970.4576

Machine Generated Data

Tags

Amazon
created on 2022-01-08

Person 99.6
Human 99.6
Person 99.5
Person 98.3
Person 97.6
Military 97.3
Person 97.1
Military Uniform 96.9
Car 96.4
Automobile 96.4
Transportation 96.4
Vehicle 96.4
Person 96.3
People 95.6
Army 93.7
Armored 93.7
Person 85.4
Wheel 83.8
Machine 83.8
Soldier 77.7
Swat Team 73.7
Person 73.5
Person 69.2
Person 67.9
Person 66.4
Team 62
Person 55.7

Clarifai
created on 2023-10-25

people 98.4
movie 95.6
train 93.9
street 93.1
locomotive 93.1
negative 92.4
man 92.2
cavalry 90.1
war 89.8
vintage 89.8
collage 89.5
retro 89.5
military 88.7
art 87.8
slide 82.6
security 82.4
vehicle window 82.3
old 82
photograph 81.6
weapon 81

Imagga
created on 2022-01-08

passenger car 51.7
car 49.2
vehicle 37.3
wheeled vehicle 35.7
conveyance 32.7
equipment 27
bus 24.4
digital 17.8
computer 16.9
technology 16.3
shuttle bus 15.8
electronic equipment 15.6
grunge 14.5
film 14.2
architecture 14
old 13.9
black 13.8
transport 13.7
business 12.7
public transport 12.7
shuttle 12.6
transportation 12.5
retro 12.3
security 11.9
design 11.8
television 11.7
metal 11.3
monitor 11.2
industry 11.1
room 10.9
screen 10.9
vintage 10.7
movie 10.7
art 10.4
network 10.2
entertainment 10.1
frame 10
dirty 9.9
modern 9.8
building 9.7
texture 9.7
hardware 9.6
object 9.5
negative 9.5
light 9.3
window 9.3
device 9.2
travel 9.1
data 9.1
door 8.8
antique 8.8
strip 8.7
center 8.7
weathered 8.5
grungy 8.5
server 8.4
service 8.3
city 8.3
interior 8
steel 7.9
working 7.9
noise 7.8
people 7.8
slide 7.8
3d 7.7
rust 7.7
tech 7.6
amplifier 7.5
camera 7.5
safety 7.4
border 7.2
broadcasting 7.2
home 7.2
information 7.1

Google
created on 2022-01-08

Wheel 85.1
Font 83.3
Vehicle 82.5
Tire 78.1
Picture frame 76.5
Motor vehicle 75.3
Suit 70.6
Poster 69.9
Rectangle 68.2
Room 67.9
Musical instrument 67.1
History 64.4
Monochrome 62.3
Advertising 61.3
Monochrome photography 57
Car 54.5
Family car 54.2
Metal 52.6
Photographic paper 52.4
Illustration 51.1

Microsoft
created on 2022-01-08

text 97
vehicle 94.4
land vehicle 92.8
car 83.1
wheel 79.3

Color Analysis

Face analysis

Amazon

AWS Rekognition

Age 36-44
Gender Male, 72.3%
Calm 78.4%
Confused 6%
Disgusted 5.8%
Surprised 2.7%
Sad 2.5%
Angry 2.5%
Fear 1.2%
Happy 0.9%

AWS Rekognition

Age 10-18
Gender Male, 95.9%
Sad 43%
Happy 24.2%
Angry 12.5%
Calm 5.1%
Confused 4.8%
Surprised 4.5%
Disgusted 4.2%
Fear 1.7%

AWS Rekognition

Age 21-29
Gender Male, 99.2%
Calm 47.7%
Angry 31.7%
Sad 8.8%
Disgusted 5.3%
Happy 2.2%
Confused 2.1%
Fear 1.2%
Surprised 1%

AWS Rekognition

Age 27-37
Gender Male, 99.7%
Sad 39%
Calm 34.7%
Angry 12%
Confused 10.3%
Happy 1.7%
Surprised 1%
Disgusted 0.9%
Fear 0.5%

AWS Rekognition

Age 24-34
Gender Male, 92.3%
Calm 81.4%
Angry 7.4%
Sad 4.2%
Fear 3.7%
Disgusted 1.5%
Happy 0.8%
Confused 0.6%
Surprised 0.5%

Feature analysis

Amazon

Person 99.6%
Car 96.4%
Wheel 83.8%

Categories

Imagga

interior objects 72.6%
cars vehicles 22.3%
streetview architecture 2.4%
text visuals 1.7%

Captions

Microsoft
created on 2022-01-08

graphical user interface 82.8%

Text analysis

Amazon

19
6

Google

61 19
61
19