Human Generated Data

Title

Untitled (three photographs: Cuban revolutionaries)
Date

c. 1950, printed later
People

Artist: Lester Cole, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.12244

Human Generated Data

Title

Untitled (three photographs: Cuban revolutionaries)

People

Artist: Lester Cole, American

Date

c. 1950, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-25

Poster 99.9
Advertisement 99.9
Collage 99.9
Human 92.7
Person 92.7
Person 87.3
Person 82.3
Electronics 80.8
Display 80.8
Monitor 80.8
Screen 80.8
Person 79.4
Car 73.1
Automobile 73.1
Vehicle 73.1
Transportation 73.1
Person 72.9
Person 67.3
Person 67.1
Person 67.1
Car 64.6
Monitor 64.4
Car 62.7
Person 59.6
Person 41.7

Imagga
created on 2022-02-25

monitor 55.6
signboard 42.9
billboard 41.7
electronic equipment 36.9
liquid crystal display 31.2
equipment 29.2
structure 24.7
light-emitting diode 16.7
blackboard 15
television 13.9
board 13.8
display 13.5
technology 13.4
business 13.4
diode 13.3
map 13.1
design 12.9
screen 12.8
global 12.8
finance 12.7
computer 12.3
hand 12.2
web site 11.5
scoreboard 11.5
money 11.1
symbol 10.8
sport 10.7
collage 10.6
people 10.6
navigation 10.6
digital 10.5
man 10.1
person 10
old 9.7
building 9.3
car 9.2
banking 9.2
frame 9.1
bank 8.9
film 8.9
office 8.8
paper 8.6
system 8.6
3d 8.5
electronic 8.4
dollar 8.3
sky 8.3
road 8.1
currency 8.1
close 8
icon 7.9
navigator 7.9
bright 7.9
position 7.8
black 7.8
flat 7.7
skill 7.7
nation 7.6
silhouette 7.4
lights 7.4
training 7.4
street 7.4
speed 7.3
competition 7.3
financial 7.1
window 7.1
travel 7
modern 7

Google
created on 2022-02-25

Black 89.8
Art 84.9
Font 82.7
Rectangle 82.6
Wall 81.2
Snapshot 74.3
Electronic device 73.9
Technology 73.6
Display device 70.5
Room 70
Advertising 68.6
Event 67.6
Visual arts 67.4
Stock photography 63.3
Graphics 61.2
Multimedia 61.1
Collection 57
Photographic paper 56.8
Illustration 55
Suit 54.9

Microsoft
created on 2022-02-25

cartoon 93.9
text 93.6
person 87.6
poster 87.4
gallery 72.9
drawing 69.3
billboard 67.7
screenshot 57.8
room 53.6

Face analysis

Amazon

Google

AWS Rekognition

Age 20-28
Gender Male, 88.3%
Calm 72.7%
Sad 9.2%
Fear 6.6%
Surprised 4.4%
Disgusted 2.5%
Angry 2.3%
Confused 1.4%
Happy 0.9%

AWS Rekognition

Age 18-24
Gender Male, 97.9%
Calm 77.5%
Surprised 6.8%
Confused 6.2%
Fear 4.8%
Sad 1.8%
Happy 1.1%
Disgusted 1.1%
Angry 0.7%

AWS Rekognition

Age 23-31
Gender Male, 85.7%
Sad 88.1%
Angry 4.1%
Calm 2.7%
Fear 2.3%
Disgusted 0.8%
Confused 0.8%
Happy 0.7%
Surprised 0.6%

AWS Rekognition

Age 28-38
Gender Male, 99.3%
Calm 43%
Fear 36%
Sad 17.8%
Angry 1.2%
Confused 1%
Disgusted 0.4%
Happy 0.3%
Surprised 0.3%

AWS Rekognition

Age 36-44
Gender Male, 87.5%
Calm 76.4%
Sad 19%
Happy 1.6%
Angry 1.4%
Fear 0.9%
Surprised 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 23-33
Gender Male, 98%
Calm 92.3%
Happy 4%
Fear 1.7%
Sad 0.7%
Surprised 0.6%
Angry 0.3%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Male, 99.8%
Happy 34.6%
Sad 23.2%
Calm 23.1%
Fear 10.9%
Angry 2.9%
Surprised 2.1%
Disgusted 1.6%
Confused 1.5%

AWS Rekognition

Age 21-29
Gender Female, 97.1%
Fear 56.9%
Surprised 18.7%
Happy 13.9%
Calm 6.9%
Sad 1.2%
Angry 1%
Disgusted 0.8%
Confused 0.7%

AWS Rekognition

Age 21-29
Gender Male, 99.4%
Sad 40.8%
Calm 30.3%
Angry 10.5%
Surprised 5.7%
Disgusted 5.2%
Fear 3.1%
Confused 2.4%
Happy 2.1%

AWS Rekognition

Age 20-28
Gender Male, 98.9%
Calm 99.7%
Confused 0.1%
Sad 0.1%
Angry 0%
Surprised 0%
Disgusted 0%
Fear 0%
Happy 0%

AWS Rekognition

Age 16-24
Gender Female, 68%
Fear 91.3%
Sad 5%
Confused 1.3%
Calm 0.7%
Surprised 0.7%
Angry 0.4%
Happy 0.4%
Disgusted 0.3%

AWS Rekognition

Age 20-28
Gender Male, 92.7%
Calm 58.3%
Angry 16%
Confused 5.9%
Sad 5.8%
Happy 5.5%
Surprised 3.9%
Disgusted 2.4%
Fear 2.2%

AWS Rekognition

Age 14-22
Gender Male, 99.6%
Calm 93.4%
Surprised 1.5%
Fear 1.3%
Angry 1.3%
Sad 0.9%
Disgusted 0.6%
Happy 0.5%
Confused 0.5%

AWS Rekognition

Age 27-37
Gender Male, 88.4%
Sad 91.1%
Calm 2.8%
Disgusted 1.5%
Confused 1.4%
Fear 1.2%
Happy 0.9%
Angry 0.7%
Surprised 0.5%

AWS Rekognition

Age 19-27
Gender Female, 95.9%
Calm 96.7%
Surprised 1%
Confused 0.6%
Disgusted 0.5%
Fear 0.4%
Angry 0.3%
Sad 0.2%
Happy 0.2%

AWS Rekognition

Age 23-31
Gender Male, 99.9%
Calm 97.2%
Confused 0.9%
Surprised 0.8%
Fear 0.3%
Sad 0.2%
Disgusted 0.2%
Angry 0.1%
Happy 0.1%

AWS Rekognition

Age 19-27
Gender Female, 66.2%
Calm 51.1%
Angry 16.3%
Fear 14.9%
Sad 6.3%
Happy 4.5%
Confused 3%
Disgusted 2.8%
Surprised 1.1%

AWS Rekognition

Age 23-31
Gender Female, 78.3%
Calm 96.2%
Sad 2.4%
Surprised 0.4%
Confused 0.3%
Disgusted 0.3%
Angry 0.2%
Happy 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 71.1%
Angry 10.6%
Sad 8.5%
Confused 5%
Happy 3.2%
Surprised 0.6%
Disgusted 0.6%
Fear 0.5%

AWS Rekognition

Age 10-18
Gender Male, 92.8%
Calm 57.8%
Fear 24%
Surprised 6.5%
Happy 5.1%
Sad 2.5%
Angry 2.3%
Disgusted 1.3%
Confused 0.4%

AWS Rekognition

Age 23-31
Gender Male, 100%
Calm 91.2%
Happy 5.1%
Surprised 1.7%
Angry 1.2%
Sad 0.5%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 12-20
Gender Female, 53.1%
Calm 47.8%
Angry 21.8%
Fear 10%
Confused 7.1%
Happy 4.6%
Sad 3.5%
Disgusted 3.3%
Surprised 1.8%

AWS Rekognition

Age 18-24
Gender Male, 96.3%
Angry 71.1%
Fear 12.9%
Calm 6.2%
Sad 5.8%
Disgusted 1.8%
Surprised 1%
Happy 0.7%
Confused 0.5%

AWS Rekognition

Age 36-44
Gender Female, 55.7%
Happy 99.1%
Calm 0.2%
Angry 0.1%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Male, 70%
Fear 32.2%
Calm 30.6%
Sad 11.5%
Happy 8.5%
Angry 8%
Confused 4.8%
Disgusted 2.9%
Surprised 1.6%

AWS Rekognition

Age 13-21
Gender Male, 99%
Sad 67.4%
Calm 16.7%
Confused 7.1%
Disgusted 2.8%
Happy 2.4%
Angry 1.6%
Surprised 1.2%
Fear 0.8%

AWS Rekognition

Age 19-27
Gender Male, 96.8%
Calm 64.5%
Sad 22.1%
Confused 7.3%
Angry 2.4%
Happy 1.2%
Fear 1.1%
Disgusted 0.9%
Surprised 0.6%

AWS Rekognition

Age 16-22
Gender Female, 69.3%
Calm 52.2%
Sad 36.3%
Fear 6.8%
Happy 2.1%
Disgusted 0.9%
Angry 0.7%
Confused 0.6%
Surprised 0.4%

AWS Rekognition

Age 18-24
Gender Male, 90.2%
Sad 20.4%
Fear 19.7%
Surprised 19.3%
Disgusted 15.8%
Calm 13.5%
Angry 5.6%
Happy 3.9%
Confused 1.8%

AWS Rekognition

Age 18-24
Gender Male, 91.6%
Sad 88%
Fear 7.3%
Calm 2%
Angry 0.8%
Confused 0.7%
Surprised 0.5%
Happy 0.4%
Disgusted 0.2%

AWS Rekognition

Age 20-28
Gender Male, 98.8%
Calm 72.9%
Fear 18.5%
Confused 2.2%
Sad 1.8%
Angry 1.7%
Surprised 1.4%
Disgusted 0.8%
Happy 0.5%

AWS Rekognition

Age 29-39
Gender Male, 78.4%
Sad 87.7%
Calm 11.6%
Happy 0.3%
Fear 0.1%
Angry 0.1%
Confused 0.1%
Disgusted 0.1%
Surprised 0%

AWS Rekognition

Age 30-40
Gender Male, 57.4%
Calm 97.5%
Fear 1.9%
Sad 0.2%
Surprised 0.1%
Disgusted 0.1%
Angry 0.1%
Confused 0.1%
Happy 0.1%

AWS Rekognition

Age 23-31
Gender Male, 95.2%
Calm 80.5%
Sad 7.2%
Surprised 3.8%
Happy 2.2%
Fear 2.1%
Confused 2.1%
Angry 1.3%
Disgusted 0.8%

AWS Rekognition

Age 16-24
Gender Male, 98.7%
Sad 80.8%
Confused 7.5%
Calm 7.2%
Angry 1.5%
Disgusted 1.5%
Fear 0.6%
Surprised 0.5%
Happy 0.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Feature analysis

Amazon

Person 92.7%
Monitor 80.8%
Car 73.1%

Captions

Microsoft

a group of people posing for a photo in front of a television 51.6%
a group of people standing in front of a television 51.5%
a group of people in front of a television 51.4%

Text analysis

Amazon

3