Human Generated Data

Title

Untitled (group of draftees standing in front of bus)
Date

1941
People

Artist: Harry Annas, American 1897 - 1980
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3444

Human Generated Data

Title

Untitled (group of draftees standing in front of bus)

People

Artist: Harry Annas, American 1897 - 1980

Date

1941

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.3444

Machine Generated Data

Tags

Amazon
created on 2022-01-22

Person 99.3
Human 99.3
Person 98.8
Person 97.4
Person 96.8
Person 96.5
Poster 96
Advertisement 96
Person 95.4
Text 92.9
Person 87.6
Person 87.2
Person 76.4
Face 72.1
Person 69.9
Sailor Suit 60.4
People 59.8
Clothing 57.7
Apparel 57.7
Person 41.7

Clarifai
created on 2023-10-26

people 99.3
adult 92.6
vehicle 86.6
group 84.2
monochrome 84.1
man 80.2
no person 79.9
many 78.2
transportation system 77.1
education 75.6
one 74.5
leader 73
wear 72.5
text 70.7
watercraft 69.6
railway 69
retro 68
street 66.8
commerce 66.1
war 66.1

Imagga
created on 2022-01-22

money 28.1
daily 25.6
grunge 24.7
paper 24.3
currency 24.2
old 23.7
business 22.5
dollar 22.3
vintage 21.5
cash 21.1
bank 20.7
finance 20.3
retro 19.7
billboard 19.1
bill 19
blackboard 17.8
signboard 17.7
structure 16.9
texture 16.7
banking 16.5
hundred 15.5
us 15.4
text 14.8
antique 14.7
note 14.7
financial 14.3
rich 14
stall 13.6
sign 13.5
wealth 13.5
material 13.4
exchange 13.4
damaged 13.4
frame 13.3
shop 13.1
savings 13.1
aged 12.7
border 12.7
dirty 12.7
black 12.6
banknote 12.6
dollars 12.6
close 12.6
art 11.8
design 11.8
grungy 11.4
ancient 11.2
wall 11.1
newspaper 10.8
bills 10.7
graphic 10.2
barbershop 9.6
pay 9.6
pattern 9.6
old fashioned 9.5
space 9.3
banknotes 8.8
frames 8.8
film 8.8
closeup 8.8
states 8.7
collage 8.7
finances 8.7
edge 8.7
empty 8.6
save 8.5
grain 8.3
mercantile establishment 8.3
investment 8.3
historic 8.2
one 8.2
rough 8.2
symbol 8.1
scratches 7.9
franklin 7.9
noise 7.8
ragged 7.8
color 7.8
crumpled 7.8
movie 7.8
your 7.7
payment 7.7
parchment 7.7
loan 7.7
notes 7.7
device 7.7
united 7.6
product 7.6
computer 7.3
digital 7.3
paint 7.2
liquid crystal display 7.2
home appliance 7

Google
created on 2022-01-22

Picture frame 86
Font 83.9
Rectangle 83.9
Art 79.2
Pattern 69.7
Visual arts 68.5
Monochrome 66.3
Monochrome photography 64.7
Paper 63.8
Paper product 63
History 61.3
Illustration 59.7
Collection 57
Room 55.3
Painting 53.4
Number 51.3
Graphics 50.6

Microsoft
created on 2022-01-22

text 99.9
drawing 98
monitor 92.4
black and white 89.1
painting 80.9
poster 72.1
cartoon 71.1
billboard 66.8
sketch 66.2
image 34.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 34-42
Gender Male, 99.6%
Happy 64.9%
Calm 29.4%
Angry 2.3%
Disgusted 1.3%
Sad 0.9%
Surprised 0.8%
Fear 0.3%
Confused 0.2%

AWS Rekognition

Age 29-39
Gender Female, 91.8%
Calm 66.4%
Happy 24.6%
Confused 2.8%
Surprised 2%
Sad 1.8%
Angry 1%
Disgusted 0.8%
Fear 0.6%

AWS Rekognition

Age 38-46
Gender Female, 85.7%
Happy 70.3%
Fear 26.9%
Calm 1.6%
Surprised 0.3%
Sad 0.3%
Angry 0.3%
Disgusted 0.2%
Confused 0.2%

AWS Rekognition

Age 27-37
Gender Male, 98.3%
Happy 77.6%
Calm 21.3%
Angry 0.3%
Sad 0.2%
Disgusted 0.2%
Surprised 0.1%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 34-42
Gender Male, 81.8%
Calm 96.7%
Happy 1%
Disgusted 0.5%
Angry 0.5%
Sad 0.4%
Fear 0.4%
Confused 0.3%
Surprised 0.1%

AWS Rekognition

Age 22-30
Gender Female, 96.9%
Happy 99.4%
Fear 0.2%
Angry 0.2%
Disgusted 0%
Surprised 0%
Calm 0%
Sad 0%
Confused 0%

AWS Rekognition

Age 29-39
Gender Male, 89%
Happy 50%
Calm 43%
Sad 3.8%
Confused 1.1%
Angry 0.7%
Fear 0.6%
Disgusted 0.5%
Surprised 0.3%

AWS Rekognition

Age 45-51
Gender Female, 99.1%
Happy 50%
Calm 46.1%
Disgusted 1.8%
Fear 1.1%
Sad 0.5%
Angry 0.3%
Confused 0.2%
Surprised 0.1%

AWS Rekognition

Age 27-37
Gender Female, 51.8%
Happy 97.5%
Calm 1.3%
Angry 0.4%
Sad 0.3%
Confused 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 38-46
Gender Male, 96.7%
Happy 87.6%
Calm 11.2%
Disgusted 0.4%
Sad 0.2%
Angry 0.2%
Surprised 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Calm 77.5%
Happy 13.5%
Surprised 4.4%
Confused 1.2%
Fear 1.1%
Angry 1%
Disgusted 1%
Sad 0.4%

AWS Rekognition

Age 34-42
Gender Female, 52.6%
Calm 61.6%
Happy 12.5%
Sad 11.4%
Disgusted 4.8%
Angry 4.1%
Confused 2.2%
Fear 2.1%
Surprised 1.4%

AWS Rekognition

Age 26-36
Gender Male, 88.2%
Calm 95.1%
Happy 1.4%
Sad 1%
Angry 1%
Disgusted 0.6%
Surprised 0.5%
Confused 0.2%
Fear 0.2%

AWS Rekognition

Age 24-34
Gender Male, 90.7%
Calm 47.9%
Happy 24.6%
Disgusted 10.7%
Angry 6.2%
Fear 3.6%
Surprised 3.5%
Sad 2.7%
Confused 0.8%

AWS Rekognition

Age 28-38
Gender Female, 82%
Happy 97.8%
Sad 0.5%
Surprised 0.4%
Fear 0.3%
Disgusted 0.3%
Calm 0.2%
Confused 0.2%
Angry 0.2%

AWS Rekognition

Age 48-54
Gender Male, 94.5%
Happy 66%
Calm 32%
Angry 0.6%
Surprised 0.4%
Disgusted 0.4%
Sad 0.3%
Confused 0.2%
Fear 0.1%

AWS Rekognition

Age 36-44
Gender Male, 99.3%
Calm 84.4%
Happy 7.5%
Angry 6.5%
Fear 0.5%
Disgusted 0.4%
Confused 0.3%
Surprised 0.2%
Sad 0.2%

AWS Rekognition

Age 45-53
Gender Male, 99.4%
Fear 88.8%
Sad 4.1%
Calm 2%
Happy 1.8%
Disgusted 1.2%
Confused 0.8%
Angry 0.7%
Surprised 0.7%

AWS Rekognition

Age 25-35
Gender Male, 98.8%
Sad 41.2%
Fear 36.9%
Calm 6%
Happy 4.6%
Angry 3.4%
Confused 3.3%
Surprised 3%
Disgusted 1.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Possible

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Poster 96%

Categories

Imagga

cars vehicles 38.5%
text visuals 27.4%
streetview architecture 22.8%
paintings art 10.3%

Captions

Microsoft
created on 2022-01-22

an old photo of a person 61.2%
old photo of a person 57.6%
a screen shot of a person 57.5%

Text analysis

Amazon

RT
Friendly
Friendly Service
RT HARDW
9
Service
TIRES
TUBES
MP
HARDW
CLAIR
NC
NY.
HC
Steeliner
FISK
SPEDIA
BASOLINE
CARMUES

Google

INCLAIR RT HARDW FISK TIRES TUBES Friendly Service Steeliner.
INCLAIR
RT
HARDW
FISK
TIRES
TUBES
Friendly
Service
Steeliner.